Model 2601B-PULSE System SourceMeter Instrument Reference Manual Section 11: TSP command reference
2601B-PULSE-901-01A April 2020 11-89
format.asciiprecision
This attribute sets the precision (number of digits) for all numbers returned in the ASCII format.
Instrument reset
Recall setup
Usage
precision = format.asciiprecision
format.asciiprecision = precision
A number representing the number of digits to be printed for numbers printed with
the print(), printbuffer(), and printnumber() functions; must be a number
between 1 and 16
Details
This attribute specifies the precision (number of digits) for numeric data printed with the print(),
printbuffer(), and printnumber() functions. The format.asciiprecision attribute is only
used with the ASCII format. The precision value must be a number from 0 to 16.
Note that the precision is the number of significant digits printed. There is always one digit to the left
of the decimal point; be sure to include this digit when setting the precision.
Example
format.asciiprecision = 10
x = 2.54
printnumber(x)
format.asciiprecision = 3
printnumber(x)
Output:
2.540000000e+00
2.54e+00
Also see
format.byteorder (on page 11-89)
format.data (on page 11-91)
print() (on page 11-153)
printbuffer() (on page 11-154)
printnumber() (on page 11-155)
format.byteorder
This attribute sets the binary byte order for the data that is printed using the printnumber() and
printbuffer() functions.
Instrument reset
Recall setup