280
APPENDIX
Function Calculation range Notes
n > 0
|Σx| < 1 × 10
50
|(Σx) (Σy)| < 1 × 10
100
0 < |Σx
2
– | < 1 × 10
100
b|Σxy – | < 1 × 10
100
< 1 × 10
100
a
|bx| < 1 × 10
100
|y – bx| < 1 × 10
100
y’
|bx| < 1 × 10
100
|a + bx| < 1 × 10
100
x’
|y – a| < 1 × 10
100
| | < 1 × 10
100
Regression calcula-
tions excluding 2nd,
3rd and 4th degree
polynomials.
Same as above.
Same as b for other.
In principle, the residual for calculations is ±1 of the last digit (in case of exponential
display, the residual is ±1 of the last digit of the mantissa display).
However, the residual increases in continuous calculations due to accumulation of each
residual (this is the same for squares (a
b
) and square roots ( ) where continuous
calculations are performed internally).
Moreover, errors will accumulate and become larger in the vicinity of inflection points
and singular points of functions.
EL-9650-Appendix (265-281) 8/3/00, 5:06 PM280