How to use Groq in BoltAI

Groq hosts open models and answers fast. In BoltAI you can chat with them and use Groq to turn your speech into text.

Before you start

An API key from the Groq Console.

Set up Groq in BoltAI

1. Open Settings › AI Providers and click +.
2. Choose Groq under Other Providers.
3. Paste your key into API Key. Leave Base URL empty.
4. Click Next.
5. Keep all models, or untick the ones you don't want. To choose the model this provider starts with, hover over it and click Set as Default.
6. Click Add Service.

Start a chat with Groq models

Click the model name in the message box, press ⇧ ⌘ M, or type /model, and pick a model under Groq.

To start every new chat with it, right-click the model and choose Set Provider & Model as Default. See Choose and switch models.

Use Groq for speech to text

1. Open Settings › Voice.
2. Under Speech to Text, set Engine to Groq.
3. Pick a Model, and a Language or Auto Detect.

See Instant Dictation.

If it doesn't connect

• BoltAI couldn't verify the setup. Copy the key again from the Groq Console, paste it into API Key, and click Next.
• It stopped working later. Open Settings › AI Providers, click Groq, open the ⋯ menu and choose Test Connection. To change the key, choose Edit Configuration.
• A new model is missing. Click Groq in Settings › AI Providers and click Refresh Model List.