19990401
2-1-2
Basic Calculations
*
1
Displayed values are rounded off to the place
you specify.
kk
kk
k Number of Decimal Places, Number of Significant Digits, Normal
Display Range
[SET UP]- [Display] -[Fix] / [Sci] / [Norm]
•Even after you specify the number of decimal places or the number of significant digits,
internal calculations are still performed using a 15-digit mantissa, and displayed values
are stored with a 10-digit mantissa. Use Rnd of the Numeric Calculation Menu (NUM)
(page 2-4-1) to round the displayed value off to the number of decimal place and number
of significant digit settings.
•Number of decimal place (Fix) and number of significant digit (Sci) settings normally
remain in effect until you change them or until you change the normal display range
(Norm) setting.
Example 100 " 6 = 16.66666666...
Condition Operation Display
100/6w 16.66666667
4 decimal places u3(SET UP)
cccccccccc
*
1
1(Fix)ewiw 16.6667
5 significant digits u3(SET UP)
cccccccccc
*
1
2(Sci)fwiw 1.6667E+01
Cancels specification u3(SET UP)
cccccccccc
3(Norm)iw 16.66666667
To Next Page
Loading...
Need help?
General
