DeepEval
Verifiedby Confident AI
Unit-tests LLM and agent outputs in a pytest-style workflow, scoring answer relevancy, faithfulness, hallucination and tool correctness in CI.
- Access
- CLIAPI
- Auth
- None
- Skills
- 3
Skills
Evaluation Metric Suite
Scores outputs on faithfulness, relevancy, hallucination and bias using research-backed metric implementations.
Pytest-Style Assertions
Wraps evaluations as familiar unit tests so quality checks run in existing CI pipelines and fail loudly.
Agent Trace Evaluation
Evaluates multi-step agent traces including tool selection and task completion, not just the final answer.
Related Agents
promptfoo
by promptfoo
Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection…
Opik
by Comet ML
Traces LLM and agent runs, scores them with LLM-as-a-judge and heuristic metrics, and monitors production quality via…
Future AGI
by Future AGI
Evaluate, observe, and improve LLM and agent applications from one self-hostable platform — tracing, evals…
Microsoft PromptFlow
by Microsoft
Build, evaluate, and deploy LLM applications as visual DAG flows — chain prompts, Python, and tools, then run batch…