LLM cost tracking

LLM cost tracking down to the request

Know what every feature, customer and API key costs. LLM Gateway prices each call, attributes it and stops spend before it reaches the ceiling you set.

See pricing

Token spend is hard to see because it is spread across providers, keys and features, and it is discovered at the end of the month in an invoice nobody can decompose.

LLM Gateway prices every request at the moment it happens, against the current catalog price for the model that served it, and stores the result with the key, project and model that produced it.

What is recorded per request

Each call leaves a record that can be aggregated any way you need.

  • Provider, model and routing decision
  • Input and output tokens with the price used
  • Latency, retry history and fallback that served the request
  • Key, project, environment and optional customer tag

Controls that act before the invoice

Alerts warn when a project approaches its budget, and hard limits reject further traffic instead of quietly spending past the ceiling. Limits can be set per key, project or environment.

Cost as a routing input

Once cost is measurable it can drive routing: send high-volume, low-risk traffic to cheaper models, keep premium models for the paths that justify them, and let price ceilings move traffic automatically when a vendor changes its list price.

FAQ

Questions teams ask before switching

Short answers about the gateway, the providers and how billing works.

How accurate are the cost numbers?

Costs are computed from the token counts reported by the provider and the catalog price in effect for that model at the time of the request.

Can spend be tracked per customer?

Yes. A request can carry a customer or feature tag, and reports can be grouped by that tag, by key, by project or by model.

What happens when a budget is reached?

The key or project stops being served until the limit is raised or the next period starts, and the event is recorded in the usage log.

Can I export usage data?

Usage and cost records can be exported for finance reporting or pushed into your own warehouse from the Scale plan.

Route your first request in minutes

Sign in with Google, open the playground and price a request against the whole catalog before you change a line of production code.

LLM Cost Tracking and Budget Controls | LLM Gateway