Skip to main content

Add user prompt/instructions for a finalizing reply

so that we can tell the finalizing LLM to do a deep thesis on the parallel replies.

I constantly find that finalizing replies are too light; they basically summarize the parallel replies in a rather cursory way. A symptom of this is that, even if I use a reasoning model for finalizing, it will use very light reasoning or simply no reasoning (much lighter than a normal reply).

Because I do math-heavy science, I constantly want to tell the finalizing LLM sth like: “Check each parallel reply with independent and critical eyes, evaluate each thoroughly, point out their errors, and distill the core insight.“

3 comments

Log in to comment and vote

Comments3

  • Azure Chipmunk

    •

    Oct 2, 2025

    What I would like is to assign an agent to finalize the reply. This way I can create different agents who will focus on combining the replies in different ways. This would be very powerful.

    • Ivory Alpaca

      •

      Oct 20, 2025

      would be nice

  • Ivory Alpaca

    •

    Sep 29, 2025

    See an implemented example: