Fix models that reiterate an uncontrolled or unnecessary number of times. I recently noticed that some models, especially the latest Gemini "thinking" model, will constantly reiterate their output again and again. A simple user prompt can make the model stack up many repeated outputs, often 30-50 times. Especially when unattended, where the user canβt stop the output, it will drain a significant number of tokens. The attached image shows a single user prompt that resulted in 38 outputs from the model.

Please authenticate to join the conversation.
Open
Feature Request
10 months ago
Get notified by email when there are changes.
Open
Feature Request
10 months ago
Get notified by email when there are changes.