174 U1253B User’s and Service Guide
7 Specifications
DC Specifications
These specifications are defined for measurements taken
after at least one minute warm- up.
Table 7- 1 DC accuracy
± (% of reading + number of LSD)
Function Range
[10]
Resolution
Test current or burden
voltage
Accuracy
Voltage
[1]
50.000 mV 0.001 mV 0.05+50
[2]
500.00 mV 0.01 mV 0.025+5
1000.0 mV 0.1 mV 0.025+5
5.0000 V 0.0001 V 0.025+5
50.000 V 0.001 V 0.025+5
500.00 V 0.01 V 0.030+5
1000.0 V 0.1 V 0.030+5
Resistance
[11][15]
500.00 Ω
[3]
0.01 Ω 1.04 mA 0.05+10
5.0000 kΩ
[3]
0.0001 kΩ 416 μA0.05+5
50.000 kΩ 0.001 kΩ 41.2 μA0.05+5
500.00 kΩ 0.01 kΩ 4.12 μA0.05+5
5.0000 MΩ 0.0001 MΩ 375 nA || 10 MΩ 0.15+5
50.000 MΩ
[4]
0.001 MΩ 187 nA || 10 MΩ 1.00+5
500.00 MΩ
[4]
0.01 MΩ 187 nA || 10 MΩ 3.00+5, < 200 M
8.00+5, > 200 M
500.00 nS
[5]
0.01 nS 187 nA 1+10