Skip to main content

Log in to comment and vote

Comments7

  • Ngoc Nguyen changed status to Completed
    Team•

    Apr 22, 2024

    you can now set up groq models as custom models on TypingMind. Guideline: https://docs.typingmind.com/chat-models-settings/use-with-groq-api-(llama-3-mixtral-8x7b-gemma-7b)

  • Maroon Telescope

    •

    Apr 21, 2024

    Update: to add a custom model of Groq (eg using llama3) use:

    https://api.groq.com/openai/v1/chat/completions

    For the key

    Authorization : Bearer {apikey}

    llama3-70b-8192

    • Tan Tomato

      •

      Apr 22, 2024

      thanks a lot

  • Maroon Telescope

    •

    Apr 21, 2024

    Is it possible to add groq/llama3-70b to the list of models on typingmind?

    https://console.groq.com/docs/openai

    At the moment using the API is free so it would be great to have this option natively in typing mind.

    eg similar to the way the github program ChatAll offers (screenshot below).

    I tried setting up a custom model in TM though couldn't figure it out - not accepting the API (not sure if it needs to have a different format/header)

  • Tony Dinh

    Team•

    Mar 16, 2024

    Have you tried adding groq as a Custom Model in Typing Mind? Any problem?

    • Silver Hubble

      •

      Mar 16, 2024

      Tony Dinh I'm now using some models provided by Groq through OpenRouter (look for "nitro" models and read the providers list for each one)

    • Tan Pine

      •

      Mar 27, 2024

      Tony Dinh I did try but couldn’t figure out the right info. It wouldn’t save