Every call, clearly visible
Ontology Route for AI Agent has observability and evaluation natively built into the gateway layer. Without touching your business code, capture the full call chain of every run, score output quality continuously, and turn latency, tokens and cost into analyzable metrics.
Core capabilities
From tracing to evaluation — the complete observability loop after launch.
Distributed tracing
Rebuild the full call tree of a run with Trace / Span, seamlessly spanning models, tools and sub-tasks.
Automated evaluation
Built-in faithfulness, relevancy, toxicity, conciseness and more, plus LLM-as-a-Judge and custom scoring functions.
Real-time metrics
Latency, tokens, cost and success rate aggregated by model, task and tenant, refreshed in seconds.
Anomaly alerts
Set thresholds for latency, error rate and cost; get notified via webhook, email or Slack.
Replay & annotation
Replay any call end to end; human annotations flow back into continuous evaluation.
Cost attribution
Attribute every yuan of cost precisely to tasks, features and end users.
Full-chain trace waterfall
Every run produces a call tree that clearly shows where time goes — planning, retrieval, model inference and tool execution.
Automated evaluation
Run evaluators on sampled or full traffic and track quantitative quality scores across versions.
Whether the answer stays true to the retrieved context
How well the answer matches the user's intent
Safety and compliance score of the output
Whether the answer is concise without redundancy
Metrics dashboard
Key production metrics aggregated in real time, with automatic alerts on anomalies.
P50 latency
1.24s
P95 latency
3.10s
Success rate
99.2%
Cost (24h)
¥350
When P95 latency exceeds 3s or the error rate exceeds 1%, alerts are pushed automatically via Slack and webhook, with the corresponding trace link attached.
Observability and guardrails, a natural pair
Every guardrail block is recorded in the call chain — risks traceable to the exact request.