Interrater Reliability Tool

Our Web-based Interrater Reliability Tool simplifies interrater reliability evaluation by testing proper use of Milliman Care Guidelines® products. It supports URAC and NCQA requirements to document consistent and appropriate use of nationally recognized guidelines, testing an individual's ability to find the right guideline sections and apply them appropriately to a clinician-written case study. Help meet your care management goals with several Interrater Reliability Tool features:

  • Client-specific testing – Work with Milliman Care Guidelines to customize test features such as passing scores, automated feedback, number of test attempts allowed and others.
  • Realistic open-book format – Users have Care Guidelines® content available throughout testing, just as they would during actual case reviews.
  • Scoring and feedback pages – Users get immediate feedback on incorrect responses so they learn as they complete the test cases.
  • Tiered reporting capabilities – Determine staff-improvement needs and opportunities by giving your supervisors access to basic reports and your administrators more extensive report access.
  • Training development plans – Identify which On Demand Training modules users have completed and which they lack.

Download the Interrater Reliability Tool brochure


Please note that this site provides options for training only.

To receive a production demonstration, please contact your Account Manager.

To learn more:

Call 888-464-4746