Q&A Forum

Do I need to include instrument resolution in the uncertainty budget?

Asked by Metrology Atlas Editorial · 1 week ago · ✓ has an expert-verified answer

For a digital indicator with 0.001 mm resolution, do I still add a resolution component if I already have repeatability from 10 readings? Isn't it double counting?

1 Answer

Metrology Atlas Editorial ✓ Verified expert answer 1 week ago

Include it unless the repeatability data clearly already expresses it. The standard component for digital resolution δ is a rectangular distribution over ±δ/2: u = δ/(2√3) ≈ 0.29·δ.

The double-counting question: if your 10 readings scatter across several counts, the dispersion already contains quantization and the resolution line is redundant — many labs still carry both when the resolution term is negligible, which is harmless. But if all 10 readings are IDENTICAL (scatter hidden below resolution), the Type A estimate is zero and misleading — then the resolution component is essential and is your floor.

Rule of thumb: u_resolution is a floor, u_repeatability is measured; take whichever treatment is honest for your data, and never report combined uncertainty below the resolution floor.

Know the answer?

Sign in to post an answer under your own name.

SIGN IN TO ANSWER

Have a similar measurement problem?

Ask the community — anonymously, with as much technical detail as you can.