EvalOps / LLM Reliability

Reliability Console

Prompt, model, dataset, and grader regression testing.

DashboardDatasetsPromptsRunsNew evaluationCompare

Dashboard

LLM Reliability + EvalOps Platform

Inspect pass rate, cost, latency, and recent eval history across prompt and model versions.

Backend

ok

llm-evalops-backend v0.1.0

Pass Rate

68.8%

4 completed of 4 recent runs

Average Score

0.732

Mean composite score across completed runs

Cost

$0.1133666

Estimated total model cost for completed runs

Latency

650.7 ms

Avg 650.7 ms · p95 1,890 ms

Cost vs quality

Average score versus total run cost for completed evaluations.

Cost vs qualityCost (USD)Avg scorerag_qa_baselinerag_qa_degradedrag_qa_baselinerag_qa_baseline

Latency vs quality

Average score versus p95 latency for completed evaluations.

Latency vs qualityP95 latency (ms)Avg scorerag_qa_baselinerag_qa_degradedrag_qa_baselinerag_qa_baseline

Run history

4 recent runs

New evaluationView all runs
ID / statusDatasetPrompt / modelProgressQualityCostLatency avg / p95Created / started
369faf20-57a8-4511-b38f-669cbc7a6042completed

RAG QA Seed

f67a8007-d9ce-4816-9bed-676547a5f78b

rag_qa_baseline

76f01278-2380-4481-82d0-51394f25f108

gemini-3.1-flash-lite

20 / 20

95.0% pass

0.987 avg · 1 failed

$0.0209688899.6 ms / 1,890 ms

Aug 17, 2026, 3:58 p.m.

Aug 17, 2026, 3:58 p.m.

6fa61dcb-8a5a-4224-8523-8606fee31cc7
completed

RAG QA Seed

f67a8007-d9ce-4816-9bed-676547a5f78b

rag_qa_degraded

ca16be90-7da1-487a-adf8-35ef486bdb41

gemini-3.1-flash-lite

20 / 20

85.0% pass

0.953 avg · 3 failed

$0.0630011
808.2 ms / 908 ms

Aug 5, 2026, 9:12 p.m.

Aug 5, 2026, 9:12 p.m.

647d4df7-9029-48d6-b39f-875def2671a8completed

RAG QA Seed

f67a8007-d9ce-4816-9bed-676547a5f78b

rag_qa_baseline

76f01278-2380-4481-82d0-51394f25f108

gemini-3.1-flash-lite

20 / 20

95.0% pass

0.987 avg · 1 failed

$0.0293967745.5 ms / 867 ms

Aug 5, 2026, 8:54 p.m.

Aug 5, 2026, 8:54 p.m.

75c1cd78-5cae-49fa-be97-d0113957904bcompleted

RAG QA Seed

f67a8007-d9ce-4816-9bed-676547a5f78b

rag_qa_baseline

76f01278-2380-4481-82d0-51394f25f108

gemini-3.1-flash-lite

20 / 20

20 errors

0.0% pass

0.000 avg · 20 failed

$0149.6 ms / 214 ms

Aug 5, 2026, 8:39 p.m.

Aug 5, 2026, 8:39 p.m.