Saving tons of money on no rerunning prompts with "n" reponses
OpenAI can respond with multiple responses after sending one prompt. Example would be - I have a large large dialog, lots of tokens in use, and I am looking for a specific code solutions. But if gpt gives me poor code - I need to rerun it again and spend all that money on the prompt again. Or I can use something like n=3 and have 3 responses to try for the price of one prompt. Alternative use - if I need 10 ads written, Id rather use n=10 instead of asking for 10 ads in one response, because every next one is influenced by the previous one.
Log in to comment and vote
Comments2
Sapphire Wind
Jul 15, 2024
I had no idea that was a feature! Going to try it out via the API directly. Thanks - would be awesome to see in Typing Mind too.
Mar 2, 2024