1. How can we help?
  2. AI Grading
  3. How do reliability alerts work?

How do reliability alerts work?

Reliability alerts flag illegible pages, uncertain grades, or atypical grades to check before validating a grading.

In addition to the percentage-based reliability score, Examino displays reliability alerts: small orange badges that flag specific cases deserving your attention.

What triggers an alert

Reliability alerts are triggered in particular in the following cases:

  • A page of the paper is illegible.

  • A page was transcribed with a low confidence level.

  • A question or an entire paper has a low reliability score.

  • A grade appears to be an outlier (extreme compared to the rest of the paper or the class).

  • An inconsistency appears between the grading scale and a manual change made to a grade.

How to handle them

  1. Spot the orange badge on the paper or question in question.

  2. Click it to see the alert's details: the precise reason for the flag.

  3. Check the paper or grade in question, and correct it if needed.

  4. Acknowledge the alert once you've handled it, to mark it as reviewed.

Why it's useful

Alerts let you focus your attention where it matters, without having to reread every paper from start to finish. They never block validation of a grading: they are signals, not blocking errors. It's up to you to judge, case by case, whether a change is needed.

Related articles

Didn't find the answer to your question?