Chapter 11 Specifications
146
(1) Resistance Measurement Accuracy
Measurement Specifications
Conditions of guaranteed accuracy
Temperature and hu-
midity range for guar-
anteed accuracy
23±5°C, 80%RH or less
Period of guaranteed
accuracy
1 year
Temperature
coefficient
Add (±1/10th of measurement accuracy per °C) from 0 to 18°C and from 28 to
40°C.
Accuracy %rdg. + %f.s. (Calculate as f.s. = 30,000 dgt., so that 0.010% f.s. = 3 dgt.)
t
0
: Standard temperature (°C)
t : Current ambient temperature (°C)
Δt : Temperature measurement accuracy
α
t0
: Temperature coefficient (1/°C) at t
0
Measurement time (unit: ms) from TRIG input to EOM output
Integration time (detected voltage data acquisition time) reference values
∗
1. Negative values: To -10% f.s.
∗
2. The maximum display range is 99,999dgt.
(If the maximum measurement range is exceeded, the display will indicate over-range even if
the value is within the maximum display range.)
∗
3. The measurement current precision is ±5%.
∗
During temperature correction, the following value is added to the resistance measurement accuracy rdg.
error:
Range
Max.
measurement
range
*1*2
FAST MED/ SLOW
Measurement
current
*3
Open
voltage
30 m 35.000 m 0.030+0.080 0.030+0.070 300 mA
5.5 V
MAX
300 m 350.00 m 0.025+0.017 0.025+0.014 300 mA
3 3.5000 0.025+0.017 0.025+0.014 30 mA
30 35.000 0.020+0.010 0.020+0.007 10 mA
300 350.00 0.020+0.010 0.020+0.007 1 mA
3 k 3.5000 k 0.020+0.010 0.020+0.007 1 mA
30 k 35.000 k 0.020+0.010 0.020+0.007 100 A
300 k 350.00 k 0.040+0.010 0.040+0.007 5 A
3 M 3.5000 M 0.200+0.010 0.200+0.007 500 nA
-
α
t0
Δt
1+
α
t0
× (t + Δt - t
0
)
× 100 [%]
Measurement
speed
FAST
MEDIUM SLOW
50 Hz 60 Hz
Measurement
time
21 18 101 401
TC: ON, comparator: ON, tolerance ±10%±2ms
FAST (50 Hz): 20.0 ms, FAST (60 Hz): 16.7 ms, MEDIUM: 100 ms, SLOW: 400 ms
To Next Page
Loading...
Need help?
General
