27 II/28 II
Users Manual
48
DC Voltage, Conductance, and Resistance
Function Range Resolution Accuracy
mV dc 600.0 mV 0.1 mV ±(0.1 % + 1)
6.000 V 0.001 V
60.00 V 0.01 V
600.0 V 0.1 V
V dc
1000 V 1 V
±(0.05 % + 1)
600.0 Ω 0.1 Ω
±(0.2 % + 2)
[2]
6.000 kΩ 0.001 kΩ
60.00 kΩ 0.01 kΩ
600.0 kΩ 0.1 kΩ
6.000 MΩ 0.001 MΩ
±(0.2 % + 1)
Ω
50.00 MΩ 0.01 MΩ
±(1.0 % + 1)
[1]
nS
60.00 nS 0.01 nS
±(1.0 % + 10)
[1,2]
[1] Add 0.5 % of reading when measuring above 30 MΩ in the 50 MΩ range, and 20 counts below 33 nS in the 60 nS range.
[2] When using the rel function to compensate for offsets.