​
Benefits of async logging:

  • Monitor your LLM performance with 0 latency impact.
  • Operates outside the critical path of your application, ensuring no disruptions.
  • Gain comprehensive observability of your LLM applications.

​
What you will miss:

  • The ability to call over 200 LLMs using the same format.
  • Comprehensive features that ensure the scalability and reliability of your LLM applications.

​
Steps:

​
Create an account

Go to Keywords AI’s sign up page to create an account. You can use email or Google account to sign up.

​
Create an API key

To create an API key, visit the API key page

  • Name your API key for future reference
  • Pick an environment (test or production)
  • Paste your API key in the code snippet below

The API key will show up only once, Be careful and save it somewhere safe!

For the Free plan users, you can only log 10k LLM requests per month. Subscribe to our team plan to get more credits.

​
Example call:

Using the endpoint below, you can log your requests and responses to the Keywords AI API.

url = "https://api.keywordsai.co/api/request-logs/create/"

Check out the Logging endpoint page to see all supported parameters.

What is Keywords AILLM proxy