Features and Functions 4
Keysight 34970A/34972A User’s Guide 131
Measurement resolution
Resolution is expressed in terms of number of digits the instrument can measure
or display on the front panel. You can set the resolution to 4, 5, or 6 full digits, plus
a “½” digit which can only be a “0” or “1”. To increase your measurement accuracy
and improve noise rejection, select 6½ digits. To increase your measurement
speed, select 4½ digits.
This is the 10 VDC range, 5½ digits are displayed.
This is the 100 mVDC range, 4½ digits are displayed.
This is the 100 ohm range, 6½ digits are displayed.
– For temperature measurements taken from the remote interface, the resolution
is fixed at 6½ digits. From the front panel, you can set the resolution in terms of
the number of digits displayed past the decimal point (Measure menu).
– For AC voltage measurements, the resolution is fixed at 6½ digits. The only
way to control the reading rate for AC measurements is by changing the
channel delay (see page 119) or by setting the AC filter to the highest
frequency limit (see page 143).
– The specified resolution is used for all measurements on the selected channel.
If you have applied Mx+B scaling or have assigned alarms to the selected
channel, those measurements are also made using the specified resolution.
Measurements taken during the Monitor function also use the specified
resolution.
10.216,5 VDC
-045.23 mVDC
113.325,6 OHM