Support for Ollama Cloud as a custom model/API provider
I would like TypingMind to support connecting to Ollama Cloud using its official OpenAI-compatible API endpoint (https://ollama.com/v1/). Ollama Cloud offers hosted versions of models like Llama, Gemma, Nemotron, but currently TypingMind’s proxy does not support this endpoint, and browser CORS blocks direct access.
Please add proxy and/or native support for Ollama Cloud’s API endpoint, so that users can use Ollama Cloud models within TypingMind just like OpenAI or Mistral. This would enable access to the latest open-source models with easy paid hosting.
Thank you!
Log in to comment and vote
Comments7
Jul 22
PinnedWe’ve added Ollama Cloud as an official provider on TypingMind!
Rose Stapler
Jul 25
Thank you.
Red Turtle
Jun 16
support for Ollama Cloud would be amazing! i like the cloud version works well for my of my apps but would be good to access it via TM
Copper Corn
Jun 9
•Merged request
•5 votes
Ollama support
Support custom model api with popular https://ollama.ai/
Ngoc Nguyen
Feb 29, 2024
now you can set up Ollama as a custom model on TypingMind: https://docs.typingmind.com/chat-models-settings/use-with-ollama-(local-models:-llava-llama2-mistral-orca-etc.)
Feb 29, 2024
Mark this post as complete. However, if you believe we should offer better support for Ollama models, please feel free to tell me to re-open the post.
Rose Astrometry
Jun 8
Yes, this will be a great option, especially when Ollama Cloud offers good open-source models which have improved a lot in the last few months.