Overview

​

What are LLM usage metrics?

LLM usage metrics are the metrics that you can use to monitor the usage of your LLM applications. You can view metrics like: Total requests, Token usage, Errors, Latency, Cost, and break down by Model, User, API key, and Prompt.

We built a comprehensive usage dashboard to help you understand your LLM usage and optimize AI performance.

​

Why need to monitor LLM usage metrics?

• Understand how your LLM applications are performing
• Optimize your LLM usage and costs
• Monitor your LLM usage and performance by 40+ metrics
• See trends and patterns in your LLM usage