6240B DC Voltage Current Source/Monitor Operation Manual
6.6 Data Output Format (Talker Format)
6-20
2. Mantissa part and exponent part
The exponent columns below show exponents when scaling calculation is not performed.
Measurement function
Unit display
Decimal point and unit
symbol form
Exponent form
Mantissa part
Exponent
part
Mantissa part
Exponent
part
DC voltage
measurement
Mea
sure
ment
range
300 mV ddd.ddd E-03
d.dddddd
E-01
3 V d.ddddd E+00 E+00
15 V dd.dddd E+00 E+01
DC current
measurement
30 A dd.dddd E-06 E-05
300 A ddd.ddd E-06 E-04
3 mA d.ddddd E-03 E-03
30 mA dd.dddd E-03 E-02
300 mA ddd.ddd E-03 E-01
1 A d.ddddd E+00 E+00
4 A d.ddddd E+00 E+00
Resistance
measurement
Signif
icant
digits
1 digit ±0000.0d
Edd
±00000d.
Edd
00000.d
d.
2 digits 0000.dd
0000d.dd.d
dd.
3 digits d.dd
000d.dddd.d
ddd.
4 digits d.ddd
00d.ddddd.dd
ddd.d
5 digits
d.dddd
0d
.dddddd.ddd
ddd.dd
High limit value detected in resistance
measurement *1
+9.99999 E+37 +9.99999 E+37
Low limit value detected in resistance
measurement *1
+9.99999 E+36 +9.99999 E+36