2-19 User Level Calibration Commands Programming with GPIB Commands
2-54 PN: 10370-10374 Rev. F MG369xC GPIB PM
Editing the Table Data
While stored in the binary data file of the controller, the data of the five user level calibration tables can be
edited. An editor that can display the data file in hexadecimal will be needed to perform the edit.
Types of Data Storage Methods
There are three types of data storage methods used for user level calibration data. Each is described in the
following paragraphs. (The data item descriptions will refer back to these data types. )
Double:
8 bytes. Most significant byte first.
ANSI/IEEE-754 64-bit floating point format.
where:
S (1 bit) = sign bit, 0 positive, 1 negative
E (11 bits) = exponent, biased by 1023 base 10
F (52 bits) = fraction, 0 F < 1
value = [(–1) raised to the S power] [2 raised to the (E – 1023) power] [1 + F]
Example: 801 is stored as 40 89 08 00 00 00 00 00, base 16.
S = 0
E = 408 base 16 = 1032 base 10
F = .908 base 16 = .564453125 base 10
801 = 1 512 1.564453125
Integer:
4 bytes. Most significant byte first.
Stored as a signed integer. The sign bit is the most significant bit. Negative numbers are stored in 2's
complement form.
Example: 7025 is stored as 00 00 1B 71, base 16.
–7025 is stored as FF FF D4 8F, base 16 2's complement.
Short:
2 bytes. Most significant byte first.
Stored as a signed short. The sign bit is the most significant bit. Negative numbers are stored in 2's
complement form.
Example: 350 is stored as 01 5E, base 16.
–350 is stored as FE A2, base 16.
To Next Page
Loading...
Need help?
General
