Skip to main content

Save tokens by selecting relevant outputs

We can have option under each results to chose which results to reinject in discussion with LLM (to save tokens)

By default all previous results are send back to LLM, but the more we interact, we don’t want somes to pollute the discussion…

I know we already have option to send n previous messages, this one is more granular

Status: In Review5 comments

Log in to comment and vote

Comments5

  • Gold Bagel changed status to In Review
    •

    Aug 7, 2024

  • Fuchsia Banana

    •

    Jul 23, 2024

    Very useful, make a lot of sense!

  • Lavender Walrus

    •

    Jul 9, 2024

    love this idea, it also makes the ai smarter due to less clutter

  • Teal Ox

    •

    Jul 8, 2024

    similar: https://typingmind.canny.io/feature-requests/p/ephemeral-plugins

    would also love to "sticky" messages to ensure they are sent even after context window

    • Ivory Control

      •

      Jul 12, 2024

      a, or "fork thread using only selected messages" :-)