​
List Evaluators

GET /api/evaluators/ Retrieves a paginated list of evaluators for your organization.

​
Authentication

Requires API key authentication. Include your API key in the request headers: 
Authorization: Api-Key YOUR_API_KEY

​
Query Parameters

ParameterTypeDescription
pageintegerPage number for pagination (default: 1)
page_sizeintegerNumber of items per page (default: 20)
searchstringSearch evaluators by name or slug
typestringFilter by evaluator type: llm, human, or code
score_value_typestringFilter by score type: numerical, boolean, categorical, or comment
starredbooleanFilter by starred status
tagsstringFilter by tags (comma-separated)

​
Examples

import requests

url = "https://api.keywordsai.co/api/evaluators/"
headers = {
    "Authorization": "Api-Key YOUR_API_KEY"
}

# Basic list
response = requests.get(url, headers=headers)
print(response.json())

# With filters
params = {
    "type": "llm",
    "score_value_type": "numerical",
    "page_size": 10
}
response = requests.get(url, headers=headers, params=params)
print(response.json())

​
Response

Status: 200 OK 
{
  "results": [
    {
      "id": "0f4325f9-55ef-4c20-8abe-376694419947",
      "name": "Response Quality Evaluator",
      "evaluator_slug": "response_quality_v1",
      "type": "llm",
      "score_value_type": "numerical",
      "eval_class": "",
      "description": "Evaluates response quality on a 1-5 scale",
      "created_by": {
        "first_name": "Keywords AI",
        "last_name": "Team",
        "email": "admin@keywordsai.co"
      },
      "updated_by": {
        "first_name": "Keywords AI",
        "last_name": "Team",
        "email": "admin@keywordsai.co"
      },
      "created_at": "2025-09-11T09:43:55.858321Z",
      "updated_at": "2025-09-11T09:43:55.858331Z",
      "custom_required_fields": [],
      "categorical_choices": null,
      "starred": false,
      "organization": 2,
      "tags": []
    },
    {
      "id": "cat-eval-123",
      "name": "Content Quality Assessment",
      "evaluator_slug": "content_quality_categorical",
      "type": "human",
      "score_value_type": "categorical",
      "eval_class": "",
      "description": "Human assessment of content quality with predefined categories",
      "created_by": {
        "first_name": "Keywords AI",
        "last_name": "Team",
        "email": "admin@keywordsai.co"
      },
      "updated_by": {
        "first_name": "Keywords AI",
        "last_name": "Team",
        "email": "admin@keywordsai.co"
      },
      "created_at": "2025-09-11T09:44:00.000000Z",
      "updated_at": "2025-09-11T09:44:00.000000Z",
      "custom_required_fields": [],
      "categorical_choices": [
        { "name": "Excellent", "value": 5 },
        { "name": "Good", "value": 4 },
        { "name": "Average", "value": 3 },
        { "name": "Poor", "value": 2 },
        { "name": "Very Poor", "value": 1 }
      ],
      "starred": false,
      "organization": 2,
      "tags": []
    }
  ],
  "count": 2,
  "previous": null,
  "next": null,
  "current_filters": {
    "type": "llm",
    "score_value_type": "numerical"
  }
}

​
Response Fields

FieldTypeDescription
resultsarrayArray of evaluator objects
countintegerTotal number of evaluators matching filters
previousstring|nullURL for previous page (if exists)
nextstring|nullURL for next page (if exists)
current_filtersobjectApplied filters for this request

​
Error Responses

​
401 Unauthorized

{
  "detail": "Your API key is invalid or expired, please check your API key at https://platform.keywordsai.co/platform/api/api-keys"
}