Help us make TypingMind better!

Tell us how we could make TypingMind more useful to you by upvoting an existing post or creating a new post below. Thank you!

Simplify Local LLM Integration with Automatic Discovery and Native Support

I’d like to suggest a feature that could make TypingMind even better for users who run local LLMs. While TypingMind already supports custom OpenAI-compatible endpoints, configuring local inference servers such as Ollama, LM Studio, LocalAI, vLLM, llama.cpp, and similar solutions still requires manual setup. It would be fantastic to have a dedicated Local Models section that makes connecting to local LLMs much easier and more user-friendly. Some ideas that could improve the experience include: Automatic detection of local inference servers running on localhost (especially Ollama and LM Studio). One-click connection to supported local backends. Built-in presets for Ollama, LM Studio, LocalAI, vLLM, llama.cpp server, and other OpenAI-compatible APIs. Automatic discovery and listing of available models instead of requiring users to manually enter model names. A connection test with clear diagnostics when a server isn’t reachable. An optional setup wizard to guide new users through the configuration process. A streamlined setup process would significantly improve the user experience while making TypingMind an even more compelling choice for anyone who wants to combine cloud models with locally hosted models. Thank you for taking the time to read this suggestion and for continuously improving such an excellent product. I hope you’ll consider adding these enhancements in a future release.

πŸ’‘

Feature Request

12 days ago

Show Model Details in a Sortable Table

I'd like to see a table view on the provider model name screen that shows model details (release date, pricing, etc) with the ability to sort by any column. To see this information today, I have to select each model individually. To accommodate that view, I'd redo this block. It takes up way too much space currently: I'd suggest you move this cntent block into a 'Model Details' tab and put it next to the models | api keys | global settings navigation above the model list, and use this space for a sortable table. Or just shift it further over to the right. it's using up a lot of space currently. It's useful, but uses more space then necessary. writingmate.ai does a really good job at this; see screenshot below. This is what I’d like to see when I select a model provider; a table-based layout of all the models therein along w/ relevant information on each LLM the provider offers: I can sort by model, author, date dated, context, input and output, and i can enable/disable models directly from this screen. Since so many models are added each week, giving me the flexibility to sort > enable/disbable based on needs makes it faster, quicker and easier to choose a model based on credit usage. Sometimes I want the cheapest model, sometimes middle of the pack, sometimes high-tiered ones. but right now, I have to choose the provider, select the model, look in that right pane to see token cost, etc. Maybe this table view is where the 'more model details' shows up? add a 'view details' link next to the model name? If i select that, a modal slides in from the right with the model overview/parameters shown? This would streamline things greatly!

πŸ’‘

Feature Request

about 1 month ago

Multi-agent Debate

I hope there is a button to allow Multi-agent Debate Mode. This is I think even more useful than parallel agent output. MAD can save so much time analyzing a complicated topic, especially those with many sub-topics (ex: should universal basic income be implemented in the next years?) [MECHANICS] - Two or more AI language models debate a user-provided topic through structured, round-based interaction. - The human user: a) observes all outputs at every stage; b) may intervene between rounds; c) remains the final arbiter of whether consensus has been reached. [FEATURE REQUEST] - Please add a file attachment tool that allows the human user to upload and provide multiple reference files simultaneously to all participating LLMs. - The file attachment tool should support, at minimum: 1. PDF files 2. .txt files 3. Markdown files 4. docx/MS Office/LibreOffice files - The attached files should be available as shared reference material for any/all LLMs during the debate. - The human user should be able to attach files before the debate begins and, ideally, also between rounds when asking follow-up questions or requesting clarification. ** A strong multi-LLM debate protocol should not imitate a loose human panel discussion. It should behave more like a formal academic debate with controlled rounds, visible transcripts, forced engagement. - A multi-agent debate protocol should also offer the option to: - have the MAD protocol decide whether there has been full consensus on the entire list of topics, or - allow a human judge to decides whether true consensus has actually been reached on any or all of the discussion points.

πŸ’‘

Feature Request

3 months ago

1