Review Queue

Human review workflow for flagged clinical events with approve, reject, and correct actions.

The review queue is where operators and supervisors examine clinical events that the automated pipeline has flagged for human review. Events land in the queue when the confidence gates determine that automated verification alone is insufficient.

How Events Enter the Queue

Events enter the review queue through two paths:

1. LLM judge flags - The automated review judge in the connector runner evaluates an event and determines it needs human review (ambiguous data, low confidence in its own assessment, or a category that requires human sign-off)

2. Confidence threshold - Events at certain confidence levels automatically require human review before they can be promoted to verified status

Each queued event includes the full context an operator needs to make a decision: the event data, the entity it belongs to, the source transcript or record, and the LLM judge's analysis with its reasoning.

Review Actions

Operators can take three actions on a queued event:

Action	What Happens
Approve	The event's confidence is elevated to 0.95 (human-approved). It becomes eligible for EHR sync.
Reject	The event's confidence is set to 0.0 (rejected). It is excluded from entity projections and will not sync to any external system.
Correct	The operator provides corrected data. A new event is created at confidence 1.0 (authoritative) that supersedes the original. The original event is preserved for audit.

Batch operations are supported - operators can approve or reject multiple events at once when reviewing a set of similar items.

Analytics

The review queue tracks operational metrics:

• Completion rate - What percentage of queued events are reviewed within a given time window

• Distribution - How events break down by action taken (approved, rejected, corrected)

• Assignment - Which operators are handling which reviews

• Priority - Events are displayed by priority to ensure the most important items are reviewed first

The review queue is part of the platform's three-layer confidence gate system. For how events flow through automated review before reaching the human queue, see Connector Runner. For how confidence scoring works across the platform, see World Model.