Skip to main content

Plugin failure with OS Models via DeepInfra

All of the OS models I am trying to use via DeepInfra fail to execute plugins at varying rates. Every single time I request a plugin to be used, Mistral 7B just returns the function call string in the chat response, rather than actually using it to call the function. This happens less so, but still too frequently, with DeepSeek R1, Qwen3, and Llama Scout 4. This really debilitates the functionality of these models. Please fix!

Status: Closed1 comment

Log in to comment and vote

Comments1

  • Ngoc Nguyen

    Team•

    Aug 18, 2025

    this is mostly due to the model’s capability and beyond our control. If you encounter any further issue, please reach us at support@typingmind.com for support.