6241A/6242 DC Voltage Current Source/Monitor Operation Manual
6.6 Data Output Format (Talker Format)
6-20
2. Mantissa part and Exponent part
The exponent column in the list below shows cases of the Scaling calculation not being performed.
Measurement function
Unit display
Decimal point and unit
symbol form
Exponent form
Mantissa part
Exponent
part
Mantissa part
Exponent
part
DC voltage
measurement
Mea-
sure-
ment
range
300 mV ±ddd.dddd E-03 ±d.dddddd E-01
3 V ±d.dddddd E+00 E+00
30 V/6 V ±dd.ddddd E+00 E+01
DC current
measurement
30 µA ±dd.ddddd E-06 E-05
300 µA ±ddd.dddd E-06 E-04
3 mA ±d.dddddd E-03 E-03
30 mA ±dd.ddddd E-03 E-02
500 mA/300 mA
±ddd.dddd E-03 E-01
3 A ±d.dddddd E+00 E+00
5 A ±d.dddddd E+00 E+00
Resistance
measurement
Avail-
able
digits
1 digit ±0000.0d
E-09 to
E+09
±00000d. E-11 to
E+09
±00000.d
±00000d.
2 digits ±0000.dd ±0000d.d E-10 to
E+10
±0000d.d
±0000dd.
3 digits ±000d.dd ±000d.dd E-09 to
E+11
±000dd.d
±000ddd.
4 digits ±00d.ddd ±00d.ddd
±00dd.dd
±00ddd.d
5 digits ±0d.dddd ±0d.dddd
±0dd.ddd
±0ddd.dd
Detects High limit during the resistance
measurement.*1
+9.99999 E+37 +9.99999 E+37
Detects Low limit during the resistance
measurement.*1
+9.99999 E+36 +9.99999 E+36