Skip to main content

Display DeepSeek-R1 <think> tags in "Thinking..." blocks for Azure, Fireworks, and OpenRouter

Currently, DeepSeek-R1's reasoning process is handled differently depending on the API provider:

Azure Foundry & Fireworks API:

  • Model responses include tags in the main response

  • Need to parse and separate these tags into a dedicated 'Thinking…' block

OpenRouter:

  • tags are not included in responses

  • Need an alternative method to capture and display reasoning tokens in the 'Thinking…' block

DeekSeek Direct API:

Feature request

Implement proper parsing and display of DeepSeek-R1's reasoning process in a dedicated 'Thinking…' block, with provider-specific handling:

  • Parse tags from Azure Foundry and Fireworks API responses

  • Develop alternative method to capture reasoning from OpenRouter responses

This would create a consistent user experience for viewing model reasoning across all providers, similar to how DeepSeek's reasoning is displayed.

Suggested Implementation Priority:

  • Azure Foundry: Highest priority due to free API access, which would encourage more users to try DeepSeek-R1 through TypingMind

  • Fireworks API: Second priority due to superior token throughput, providing better user experience

  • OpenRouter: Lower priority due to slower token generation speed and more complex implementation requirements.

Status: Completed3 comments

Log in to comment and vote

Comments3

  • Ngoc Nguyen changed status to Completed
    Team•

    Feb 5, 2025

    Thinking message is available while using deepseek r1 via OpenRouter and Azure AI Foundry, as for fireworks, the provider does not return reasoning_content field within its response so we can not handle for now. Please help create a separate post for fireworks to get notified.

  • Fuchsia Pony

    •

    Feb 5, 2025

    Seems like while it is working for some providers, custom providers (in my use case ollama) still just putting the tags

  • Rose Pudding

    •

    Feb 4, 2025

    also groq, deepinfra, together