9.2 Accuracy
176
We define measurement tolerances in terms of f.s. (full scale), rdg. (reading) and dgt. (digit) values, with the
following meanings:
Analog output
(-01 only)
Output : Resistance measured value (display value)
Output voltage : 0 V DC (equivalent to 0 counts) to 3.1 V (equivalent to
31000 counts)
Output impedance : 1 k
Ω
Conversion method: D/A converter
No. of bits : 12 or more
Output accuracy : Resistance measurement accuracy ±0.2% f.s.
(temperature coefficient ±0.02% f.s./°C)
Conditions of accuracy guarantee:Temperature and humidity range
23 ± 5°C (73 ± 9°F), 80%RH or less (non-condensating)
Warm-up time of at least 30 min.
Response time : Resistance measurement response time + sampling
time + 1 ms
External Interfaces
9.2 Accuracy
Guaranteed Accuracy Conditions
Temperature and humidity
range for guaranteed
accuracy
23 ± 5°C (73 ± 9°F), 80% RH or less (non-condensating)
Zero-adjustment After zero adjustment
Warm-up time At least 30 minutes
Self calibration Except when using SLOW sampling, self-calibration should be executed
after warm-up.
Ambient temperature after self-calibration should be maintained within
±
2
°
C.
Measurement state Measurement taken in the same measuring environment as was in place
when zero adjustment was performed, including identical probe profile and
placement. Probe profile must not be changed during measurement.
f.s.
(maximum display value)
The maximum displayable value. This is usually the name of the currently selected range.
rdg.
(reading or displayed value)
The value currently being measured and indicated on the measuring instrument.
dgt.
(resolution)
The smallest displayable unit on a digital measuring instrument, i.e., the input value that causes the digital dis-
play to show a "1" as the least-significant digit.
To Next Page
Loading...
