There are 2 ways to add your Groq credentials to your requests:

​
Add it from the UI

1

Go to the Credentials page

2

Add your Groq credentials.

Dashboard Page

​
Add it in code

  • Add customer_credentials parameter in your request body to use your own Groq credits.
{
  // Rest of the request body
  "customer_credentials": {
    "groq": {
      "api_key": "YOUR_GROQ_API_KEY",
    }
  }
}

​
Override credentials for a particular model. (Optional)

One-off credential overrides. Instead of using what is uploaded for each provider, this targets credentials for individual models.

{
  // Rest of the request body
  "customer_credentials": {
    "groq": {
      "api_key": "YOUR_GROQ_API_KEY"
    }
  },
  "credential_override": {
    "groq/llama-3.1-8b-versatile":{ // override for a specific model.
      "api_key": "ANOTHER_GROQ_API_KEY"
    }
  }
}
AWS BedrockFireworks