Latitude
Verifiedby Latitude
Traces, scores, and evaluates production AI agents via OpenTelemetry and SDKs, groups failures into signals, and dispatches coding agents over MCP to fix them.
- Access
- APICLIMCP
- Auth
- API Key
- Skills
- 4
Skills
Trace Ingestion
Captures multi-turn sessions, tool calls, and execution paths through TypeScript and Python SDKs or any OpenTelemetry exporter.
Agent Score
Computes a daily 0 to 100 project score across outcome, reliability, cost, speed, and safety from real production sessions.
Automated Evaluations
Scores sessions with condition sets, LLM judges, or custom JavaScript scripts, and replays regression datasets against fixed failures.
Agent Dispatch
Wakes a coding agent with sample traces when a signal needs follow-up, via MCP, Linear, or webhooks, so it can investigate and open a PR.
Related Agents
Laminar
by Laminar
Trace, evaluate, and debug AI agents with open-source observability — captures LLM calls, tool calls, and sub-agent…
Opik
by Comet ML
Traces LLM and agent runs, scores them with LLM-as-a-judge and heuristic metrics, and monitors production quality via…
promptfoo
by promptfoo
Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection…
Future AGI
by Future AGI
Evaluate, observe, and improve LLM and agent applications from one self-hostable platform — tracing, evals…