Allow a user to insert a "Clear Context" block wherever they want instead of just appended to the end of the chat. This is not only a nice feature on its own but also opens up a bunch of "hidden" new capabilities that give the user a ton more flexibility in how they use the app.
One would be the ability to prompt the LLM to summarize the conversation up to that point and then add a "Clear Context" block just before the summary so only the summary remains in context. This way you only send the summary to the LLM but you still have access to the basis for the summary and would have the option to make changes and re-summarize in the future if need be.
This combined with forking would be a very powerful/efficient workflow.
Bonus points for adding a "summarize conversation" button.
Please authenticate to join the conversation.
Open
Feature Request
Chat Management/Interactions
Over 1 year ago
Get notified by email when there are changes.
Open
Feature Request
Chat Management/Interactions
Over 1 year ago
Get notified by email when there are changes.