6243/44 DC Voltage Current Source/Monitor Operation Manual
9.2.2 Voltage/Current Measurement
9-17
9.2.2 Voltage/Current Measurement
Measurement range:
However, when the integration time is 500 s or 1 ms, measurement resolution becomes as follows.
Overall accuracy: Including calibration accuracy, 1-day stability, temperature coefficients, and linearity
Range Measurement range Resolution
Voltage measurement 320 mV
3.2 V
20 V
0 to 320.000 mV
0 to 3.20000 V
0 to 20.0000 V
1 V
10 V
100 V
Current measurement 320 A
3.2 mA
32 mA
320 mA
3.2 A
10 A
0 to 320.000 A
0 to 3.20000 mA
0 to 32.0000 mA
0 to 320.000 mA
0 to 3200.00 mA
0 to 10.0000 A
1 nA
10 nA
100 nA
1 V
10 V
100 V
Integration time Resolution(digits)
500 s5
1 ms 3
Voltage measurement Range Overall accuracy (% of reading + V)
320 mV
3.2 V
20 V
0.03 + 200 V
0.03 + 200 V
0.03 + 1 mV
Current measurement Range Overall accuracy (% of reading + A + A Vo / 1 V )
320 A
3.2 mA
32 mA
320 mA
3.2 A
10 A
0.03 + 80 nA + 3 nA
0.03 + 800 nA + 30 nA
0.03 + 8 A + 300 nA
0.05 + 80 A + 3 A
0.06 + 800 A + 30 A
0.1 + 8 mA + 300 A
V
o: Compliance voltage (0 V to 20 V) (Auto Zero ON, integration time 1 to 100 PLC)