Evaluations
Evaluations
POST
You can run batch evaluations on specific metrics using this endpoint. Instead of running evaluations manually in the front-end, you could just set up evaluations_identifier
in the request body and run evaluations on the logs.
Parameters
When you are making a call to the chat/completions endpoint, you will need to pass in the evaluation_identifier to mark the logs you want to run evals on:
A list of the names of the params you defined in the custom evals page that you want to run, the one in the example looks like this in the UI