ACCURACY SPECIFICATIONS ± (% of reading + % of range)
[1]
Function Range
[2]
Test
Current
24 Hour
23°C ± 1°C
90 Day
23°C ± 5°C
1 Year
23°C ± 5°C
Temperature
Coefficient
0°C - 18°C
28°C - 55°C
Maximum
Per Lead
Resistance
DC Voltage 1.0000000 mV
[3]
10.000000 mV
[3]
100.00000 mV
1.0000000 V
10.000000 V
100.00000 V
[4]
0.0025 + .0020
0.0025 + .0002
0.0015 + .0003
0.0010 + .0003
0.0002 + .0001
0.0010 + .0004
0.0040 + .0020
0.0040 + .0002
0.0030 + .0004
0.0025 + .0004
0.0020 + .0004
0.0025 + .0005
0.0050 + .0020
0.0050 + .0003
0.0040 + .0004
0.0035 + .0004
0.0030 + .0004
0.0035 + .0005
0.0004 + .0001
0.0004 + .00002
0.0004 + .00006
0.0004 + .00004
0.0001 + .00002
0.0004 + .00005
Resistance
[5]
1.0000000 Ω
10.000000 Ω
100.00000 Ω
1.0000000 KΩ
10.000000 KΩ
100.00000 KΩ
1.0000000 MΩ
10 mA
10 mA
10 mA
1 mA
100
µA
10
µA
5
µA
0.0015 + .0002
0.0015 + .0002
0.0015 + .0002
0.0015 + .0002
0.0015 + .0002
0.0015 + .0003
0.0020 + .0003
0.0050 + .0002
0.0040 + .0002
0.0040 + .0002
0.0040 + .0002
0.0040 + .0002
0.0040 + .0004
0.0050 + .0004
0.0070 + .0002
0.0060 + .0002
0.0060 + .0002
0.0060 + .0002
0.0060 + .0002
0.0060 + .0004
0.0070 + .0004
0.0005 + .00002
0.0005 + .00001
0.0005 + .00001
0.0005 + .00001
0.0005 + .00001
0.0005 + .00002
0.0006 + .00003
1
Ω
1 Ω
10 Ω
100 Ω
1 KΩ
1 KΩ
1 KΩ
Low Power
Resistance
[5]
1.0000000 Ω
10.000000 Ω
100.00000 Ω
1.0000000 KΩ
10.000000 KΩ
100.00000 KΩ
1.0000000 MΩ
10 mA
10 mA
1 mA
100
µA
10
µA
5
µA
5
µA
0.0015 + .0002
0.0015 + .0002
0.0015 + .0002
0.0015 + .0002
0.0015 + .0004
0.0015 + .0012
0.0020 + .0003
0.0050 + .0002
0.0040 + .0002
0.0040 + .0002
0.0040 + .0002
0.0040 + .0004
0.0040 + .0015
0.0050 + .0004
0.0070 + .0002
0.0060 + .0002
0.0060 + .0002
0.0060 + .0002
0.0060 + .0004
0.0060 + .0015
0.0070 + .0004
0.0005 + .00002
0.0005 + .00001
0.0005 + .00001
0.0005 + .00001
0.0005 + .00003
0.0005 + .00003
0.0006 + .00003
1
Ω
1 Ω
10 Ω
100 Ω
1 KΩ
1 KΩ
1 KΩ
Voltage
Limited
Resistance
[5][6]
10.000000 Ω
100.00000 Ω
1 mA
100
µA
0.0020 + .0002
0.0025 + .0002
0.0050 + .0002
0.0050 + .0002
0.0070 + .0002
0.0070 + .0002
0.0005 + .00002
0.0005 + .00002
1
Ω
5 Ω
Channel 1 / Channel 2 (DCV Ratio)
Channel 1 - Channel 2 (DCV Difference)
Ratio Error % = Channel 1 accuracy in % + Channel 2 accuracy in %
Difference Error = Channel 1 (% of reading + % of range) + Channel 2 (% of reading + %
of range)
Temperature (resolution = 0.001° C)
Thermocouple
[7]
Thermistor
RTD
Thermocouple probe accuracy + 0.2° C
Thermistor probe accuracy + 0.1° C
RTD probe accuracy + 0.05° C
[1] Specifications are for Channel 1 or Channel 2, after 2-hour warm-up, resolution at 7.5 digits (100 NPLC), with FILTERS off.
RESISTANCE specifications are for 4-wire ohms or 2-wire ohms using Null. Without Null, add 0.2 Ω additional error in 2-wire ohms
function. With Analog Filter ON, add 0.002% of reading to listed specifications.
[2] 20% overrange on all ranges except 5% on Voltage Limited Resistance.
[3] After using Null. If Null is not used add 100 nanovolts.
[4] Channel 1 only.
[5] Channel 1 only. Resistance measurements, for NPLC <1, add 160
µΩ RMS noise.
[6]Voltage limit can be set to 20 mV (default), 100 mV, or 500 mV. Measured resistance plus Channel 1 HI and LO lead resistance is
limited to 10.5 Ω on the 10 Ω range and 105 Ω on the 100 Ω range.
[7] For fixed reference junction. Add 0.3° C for external reference junction, add 2° C for internal reference junction.
Chapter 8 Specifications
34420A Nano Volt/Micro Ohm Meter
276