Receiver operating characteristic curve

Last revised by Stefan Tigges on 6 Jan 2024

The receiver operating characteristic (ROC) curve is a statistical relationship used frequently in radiology, particularly with regards to limits of detection and screening.

The curves on the graph demonstrate the inherent trade-off between sensitivity and specificity:

  • y-axis: sensitivity

  • x-axis:1-specificity (false positive rate)

A perfect test would be perfectly sensitive and have no false positives (100% specific). This curve would go through the point at the very top left corner (Figure 1).

A worthless diagnostic test would be no better than chance (a straight line through the origin).

One can generate an ROC curve between these two extremes by determining the cut-off points for sensitivity and specificity given the modality, disease, and patient population in question (Figure 2).

The curve can also be used to find the point at which the trade-off between sensitivity and specificity is optimal (i.e. the apex of the curve).

ROC curves show why improvements in test sensitivity come at the cost of specificity and vice versa. Improving sensitivity by moving along the curve from left to right decreases specificity. Similarly, moving along the curve from right to left improves specificity (remember, the x-axis is 1-specificity, not specificity) at the cost of decreased sensitivity. The easiest way to remember this relationship between sensitivity and specificity is to consider the points at the extreme left and right of the ROC curve. At the extreme left, sensitivity is 0 and specificity is 1: in effect, the test always returns a negative result. Setting the test cut-off at the extreme left maximizes specificity but minimizes sensitivity. At the extreme right, sensitivity is 1 and specificity is 0: in effect, the test always returns a positive result. Setting the test cut-off at the extreme right maximizes sensitivity but minimizes specificity.

Area under the curve (AUC)

Determining the area under the curve (AUC), allows one to compare different tests. The greater the area under the curve (up to the maximum 1.0), the more accurate the test is (both better sensitivity and specificity).

An inexact guide to AUC values 3, modeled on the traditional academic points system 4, is given below:

  • 0.90-1.00: excellent accuracy

  • 0.80-0.90: good accuracy

  • 0.70-0.80: fair accuracy

  • 0.60-0.70: poor accuracy

  • 0.50: no discriminating ability

Practical points

Although the apex of the curve is the point of best trade-off in terms of sensitivity and specificity, the actual clinical diagnostic situation determines where on the ROC curve one would like to operate

History and etymology

The receiver operating curve analysis arose out of observations of differences in signal detection by radar operators in WWII 2.

ADVERTISEMENT: Supporters see fewer/no ads

Updating… Please wait.

 Unable to process the form. Check for errors and try again.

 Thank you for updating your details.