Chapter 13 Specifications
257
13
We define measurement tolerances in terms of f.s. (full scale), rdg. (reading) and dgt. (digit) values,
with the following meanings.
Example accuracy calculations
(Digits in excess of display range are truncated.)
• Resistance measurement accuracy
Measurement conditions: 100 m range, low current, OVC OFF, no zero-adjustment,
SLOW1, 30 m measurement target
Resistance measurement accuracy: ±(0.014%rdg. + 0.020%f.s.),
Additional accuracy without 0ADJ: ±0.020%f.s.
• Temperature measurement accuracy
Measurement conditions: Thermistor temperature sensor, measurement temperature of
35°C
Temperature measurement accuracy: ±(0.55+0.012×|t-30|)
• Temperature correction additional accuracy
Measurement conditions: Temperature coefficient of 3,930 ppm/°C, standard temperature
of 20°C, measurement temperature of 35°C
About Instrument Accuracy
f.s.
(maximum display value)
This is usually the name of the maximum displayable value. For this instrument, it
indicates the currently selected range.
rdg.
(reading or displayed value)
The value currently being measured and indicated on the measuring instrument.
dgt.
(resolution)
The smallest displayable unit on a digital measuring instrument, i.e., the input value
that causes the digital display to show a “1” as the least-significant digit.
±(0.014%×30 m + (0.02%+0.02%) × 100 m) = ±0.0442 m
±(0.55+0.012×|35-30|) = ±0.610°C
-
α
t0
Δt
1+
α
t0
× (t + Δt - t
0
)
× 100 [%]
Additional error
× 100 = -0.227%rdg., +0.226%rdg.
-0.393%×(±0.61)
1+0.393%×(35±0.61-20)
To Next Page
Loading...
Need help?
General
