Skip to main content

Context Limit: First message

Instead of only allowing "Last X messages", I want to set context to "First message". That way, the first message I enter can be used as a context for any follow-up query I send to the AI

Alternative: Add a new select list with options "First X messages" to keep the first and last part of the context. This could allow the AI to

  • Forget the first part of a longer conversation (using only "Last X messages")

  • Forget the last part of a longer conversation (using only "First X messages")

  • Forget the middle part of a longer conversation (using both options)

3 comments

Log in to comment and vote

Comments3

  • Teal Ox

    •

    Sep 30, 2024

    yeah similarly, i was thinking "pinned" messages in the chat can be sent always since they can have context (like the first message)

  • Ngoc Nguyen

    Team•

    Sep 17, 2024

    For First message, can you add it to system instruction, this will help remember the context too?

    • Amber Beach

      •

      Oct 8, 2024

      Ngoc Nguyen thanks for the suggestion. That's what I'm doing right now, but it means that I regularly need to update the system message:

      One agent where I'd like to implement this is a "classify and organize into one of the provided folders" type agent.

      When I change or add a folder to the list, I need to update the system message, but I'd rather change this to something like "use the folders from the next message".

      Then the system message would be constant a, and I can paste a folder list into the first message, then paste one file/document, let it classify that document, paste the next document, and so on. The agent would always see system message + first message + the last (document) and nothing else.

      Additionally, I can scroll up to verify if the folder list is still current, or if I need to start a new chat.