Save tokens by selecting relevant outputs
We can have option under each results to chose which results to reinject in discussion with LLM (to save tokens)
By default all previous results are send back to LLM, but the more we interact, we don’t want somes to pollute the discussion…
I know we already have option to send n previous messages, this one is more granular
Log in to comment and vote
Comments5
Aug 7, 2024
Fuchsia Banana
Jul 23, 2024
Very useful, make a lot of sense!
Lavender Walrus
Jul 9, 2024
love this idea, it also makes the ai smarter due to less clutter
Teal Ox
Jul 8, 2024
similar: https://typingmind.canny.io/feature-requests/p/ephemeral-plugins
would also love to "sticky" messages to ensure they are sent even after context window
Ivory Control
Jul 12, 2024
a, or "fork thread using only selected messages" :-)