Groq

There are 2 ways to add your Groq credentials to your requests:

​

Add it from the UI

1. Go to Credentials page

2. Add your Groq credentials.

​

Add it in code

• Add customer_credentials parameter in your request body to use your own Groq credits.

{
  // Rest of the request body
  "customer_credentials": {
    "groq": {
      "api_key": "your-api-key"
    }
  }
}

​

Override credentials for a particular model. (Optional)

One-off credential overrides. Instead of using what is uploaded for each provider, this targets credentials for individual models.

{
  // Rest of the request body
  "customer_credentials": {
    "groq": {
      "api_key": "your-api-key"
    }
  },
  "credential_override": {
    "groq/llama-3.1-8b-versatile":{ // override for a specific model.
      "api_key": "another-api-key"
    }
  }
}