My solutions to the 2023 HackAPrompt competition.
I finished as the top individual in the main category out of 2,742 competitors and 6th among 211 teams (user gstaff). Also 7th overall in the flan-only category.
- The submissions can be verified on the official Hackaprompt playground.
- The ChatGPT (gpt-3.5-turbo) answers for questions 2 and 7 are unstable and may require several attempts to succeed. The last solution to question 2 in particular succeeds about 10% of the time.
- Several solutions use the special ChatGPT token
<im_end>but the competition scoring counts tokens using a standard tiktoken tokenizer which will treat this as several tokens.
- All solutions but one were found manually by iterative testing in a python notebook. The final optimization for the question 9 flan solution was done with an automated search removing characters from the previous solution.
- The Tiktokenizer tool was helpful in optimizing the initial solutions.
- The total cost of finding the optimized solutions was about $5.13 in Open AI API usage for gpt-3.5-turbo (ChatGPT).
- I had the first submission with solutions to all 9 of the solved problems but initial solutions from all participants could be optimized substantially in terms of token count.
