app.knowhealth.io/compliance-ai-ops
Live walkthrough
Ella AI
Knowella
A

Compliance AI Operations

Evaluate the recordability agent's accuracy and generate the proactive compliance digest.

Recordability Evaluation

Runs the recordability agent against a labeled golden set and scores it.
Run evaluation
0/12 cases passed llama-3.3-70b-versatile
1 case failed — gc-01: the agent called a bandage recordable.
gc-01 First aid only (bandage). exp: not / got: not
gc-02 Sutures are medical treatment beyond fir… exp: recordable / got: recordable
gc-03 Prescription medication is beyond first aid. exp: recordable / got: recordable
gc-04 No treatment beyond first aid; no days away. exp: not / got: not
gc-05 Fracture + days away from work. exp: recordable / got: recordable
gc-06 Splinter removal by simple means is first aid. exp: not / got: not
gc-07 Not work-related. exp: not / got: not
gc-08 Prescription medication + restricted work. exp: recordable / got: recordable
gc-09 Work-related hearing loss case. exp: recordable / got: recordable
gc-10 Loss of consciousness after chemical exposure. exp: recordable / got: recordable
gc-11 OTC medication at nonprescription strength. exp: not / got: not
gc-12 Needlestick from a contaminated sharp. exp: recordable / got: recordable

Compliance Digest

Generates a prioritized digest from live signals and delivers it to your inbox.
Generate digest
No digest generated yet.
Overdue actions: 3 corrective actions are past due
Facilities at risk: 1 facility (Unassigned) needs attention
DART vs target: Current DART rate (0) is below industry benchmark (1.5)
Delivered to your notifications.
Ella AI
KnowHealth AI Copilot · Agent Ops
Live analysis
Golden set
0
Pass rate
0%
Regressions caught
0
Digest signals
0
What the run actually told us
!
gc-01 was the only miss — and it was an over-call
The agent read "bandage" as medical treatment.
!
Over-calling is the expensive direction
False recordables inflate DART and trigger 300A entries.
!
12 cases is a thin bar for a 100%
Only 3 sit on the first-aid boundary, where misses happen.
Digest reached notifications in one pass
All 3 signals trace back to Benchmarking data.
Ella AI · Copilot
Draft 8 edge casesLater
8 candidate cases drafted
First-aid boundary · ready for your review

Don't trust the agent.Score it.

Every recordability call graded against a labeled golden set — and a compliance digest that reaches the right inbox on its own.

Golden set
12 cases
Pass rate
100%
Digest signals
3

Compliance AI you
can actually audit.

Score the agent before it scores your incidents — then let the digest do the chasing.

0:00
0:32 1x