Hioki 3541 - Appendix 2: Temperature Correction Function (TC)

9.2 Accuracy
164
Resistance Measurement _______________________________________
• After zero adjustment
• No temperature correction
• Add temperature coefficient ±(1/10 of measurement accuracy) °C
from 0 to 18 and from 28 to 40
°C
• Warm-up time is 60 minutes (accuracy specifications are double
from 30 to 60 min)
• For FAST and MEDIUM sampling, execute self-calibration after
warm-up.
Temperature variation after warm-up should be within ±2
°C.
• Add the value calculated below to the rdg error for resistance
measurement accuracy when temperature correction is enabled:
t
0
Reference temp. [°C]
t Ambient temp. [
°C]
∆t Temp. measurement accuracy
α
t0
Temp. coefficient at t
0
[1/°C]
• Open-terminal voltage specifications in the following table may be
momentarily exceeded when the probe is removed from the test
object.
Resistance Measurement Function
*: 100 kΩ range and above are calculated as f.s. = 100,000 dgt.
9.2 Accuracy
100 α
to
– ∆t
1 α
to
+ t ∆tt
0
–+()×
---------------------------------------------------------
[%]
1-year accuracy (23 ±5°C)
(rdg = read value, f.s. = max. value, dgt. = resolution, ppm: parts per million)
Range* Displayed Values
SLOW2 SLOW1 MEDIUM FAST
Measurement
Current
Open-
Terminal
Voltage
±(ppm of rdg. + ppm of f.s.)
20mΩ 20.0000 to -0.2000 mΩ 1000+150 1000+170 1000+200 1000+250 1 A ±5% 5 Vmax
200mΩ 200.000 to -02.000 mΩ 1000+60 1000+80 1000+120 1000+170 1 A ±5% 5 Vmax
2Ω 2000.00 to -020.00 mΩ 140+40 140+60 140+100 140+150 100 mA ±5% 2.6 Vmax
20Ω 20.0000 to -0.2000 Ω 100+40 100+60 100+100 100+150 10 mA ±5% 2.6 Vmax
200Ω 200.000 to -02.000 Ω 80+15 80+30 80+40 80+100 10 mA ±5% 2.6 Vmax
2 kΩ 2000.00 to -020.00 Ω 70+15 70+30 70+40 70+100 1 mA ±5% 2.6 Vmax
20kΩ 20.0000 to -0.2000 kΩ 70+15 70+30 70+40 70+100 100 µA ±5% 2.6 Vmax
100 kΩ 110.000 to -02.000 kΩ 70+30 70+60 70+80 70+200 100 µA ±5% 13 Vmax
1MΩ 1100.00 to -020.00 kΩ 80+30 80+60 80+80 150+100 10 µA ±5% 13 Vmax
10MΩ 11.0000 to -0.2000 MΩ 400+60 400+90 400+140 3000+200 1 µA ±5% 13 Vmax
100MΩ 110.000 to -02.000 MΩ 2000+200 2000+230 2000+250
30000(3%)
+300
100 nA ±5% 13 Vmax