Situation: The nurse at a Rural Health Unit (RHU) joins a team evaluating a point-of-care hemoglobin test for anemia in pregnant women. The laboratory hemoglobin test is the reference standard. During quality checks, one point-of-care device gives almost the same reading each time the same blood sample is tested three times, but every reading is about 1.5 g/dL (15 g/L) higher than the laboratory value. How should the nurse describe this device?

Reliability is consistency: the device gives the same result on repeated testing of the same sample. Validity is accuracy: agreement with the true value from the reference standard. A device that is consistently wrong by the same amount is reliable but not valid, like a scale that always reads 2 kg too high.

Reliability and validity are separate measurement properties. The device in this scenario demonstrates one property clearly but fails the other, and distinguishing between them is essential when evaluating any point-of-care instrument.

Reliability refers to consistency or repeatability. When the same blood sample is tested three times and the device produces almost identical readings each time, it shows high test-retest reliability. The measurement error is small, and the device is precise. In the context of point-of-care hemoglobin testing, this is an important quality because a device that fluctuates randomly cannot be trusted for clinical decisions, even if its average value happens to be correct.

Validity refers to accuracy, or agreement with the reference standard. The laboratory hemoglobin test serves as the gold standard in this evaluation. The point-of-care device consistently reads about 1.5 g/dL (15 g/L) higher than the laboratory value. This is a systematic error, also called bias. Because the device does not agree with the true value, it lacks validity. The error is not random; it is a fixed offset in one direction.

A device that gives the same wrong answer every time is reliable but not valid. The classic analogy is a bathroom scale that always reads 2 kg too high: it is consistent, but it is not accurate. The same principle applies to hemoglobin testing. A point-of-care device with a consistent positive bias of 1.5 g/dL could lead to underdiagnosis of anemia if the clinical threshold is not adjusted, because the reading will overestimate the true hemoglobin concentration.

Watch out! High reliability does not compensate for poor validity. A device can be perfectly consistent yet systematically wrong. Conversely, a device can be valid on average but unreliable if individual readings scatter widely around the true value.

Key point! In point-of-care hemoglobin evaluation, both properties must be assessed separately. Reliability is checked by repeated testing of the same sample. Validity is checked by comparing the device result against a laboratory reference standard. The device in this scenario passes the reliability check but fails the validity check.

The distinction matters in rural health practice. A point-of-care hemoglobin device used for anemia screening in pregnant women must be both precise and accurate. A consistent upward bias of 1.5 g/dL could shift a woman with a true hemoglobin of 10.5 g/dL into the normal range on the device, delaying iron supplementation or further evaluation. Quality checks should therefore include both repeatability testing and comparison with a laboratory standard to detect systematic bias before the device is used for clinical decision-making.