HP HP-32S - Limitations on Precision of Data

"STAfl {LR.} {m} 0.0387
STATl {L.R.} {b} 4.8560
y
B.50--
7.50
6.50 +
5.50
b
r=0.98B0
%f
/77=0.0387
Slope of the line,
y-intercept.
Jt 170.9)
4.50 H r-
20 40 60 80
H—x
What if 70 kg of nitrogen fertilizer were applied to the rice field? Pre
dict the grain yield based on the above statistics.
Keys:
70
Display:
70_
Hi STAT I {L.R.} {y} 7.5615
Description:
Enters hypothetical x-
value.
The predicted yield in
tons per hectare.
Limitations on Precision of Data
Since the calculator uses finite precision (12 to 15 digits), it follows
that there are limitations to calculations due to rounding. Here are
two examples:
160 11: Statistical Operations