Implement RouteLLM

Sometimes I just want to ask a question and not have to think about getting the proper LLM (cost vs strength vs …). I’d like to just have RouteLLM be my default and let it choose which actual LLM to utilize.

Abacus.ai has this feature, and it may (?) be built upon this (or it may be their own):

https://lmsys.org/blog/2024-07-01-routellm/

https://github.com/lm-sys/RouteLLM

https://www.threads.com/@thetripathi58/post/DHncBeEutpp/video-3-routellm-best-llm-for-your-question-why-settle-for-one-model-chatllm-picks-the?hl=en