- 42 -
CALCULATION METHOD
9
1. Significant figure
Significant figures of calculation are as follows.
When significant figures (figures after the decimal point) of input data are A, signifi-
cant figures are displayed.
Significant Figure
Displayed
Sign Meaning
significant figure
Error
(figure after the
decimal point)
DATA Input data A —
N Data count 0 —
MAX Maximum value A —
MIN Minimum value A —
R Range A —
X Mean A+2 Last figure±1
σn Standard deviation A+2 Last figure±1
σn-1 Standard deviation A+2 Last figure±1
P Percent defective 3 (**.***%) Last figure±1
CP Process capability index 3 Last figure±1
CPK Process capability parameter 3 Last figure±1
LSL Lower limit value A Last figure±1
USL Upper limit value A Last figure±1
DIV Histogram division number 10 division fix —
Histogram region express A+2 Last figure±1
X Center (X control) A+2 Last figure±1
X-UCL Upper control limit (X control) A+2 Last figure±1
X-LCL Lower control limit (X control) A+2 Last figure±1
R Center (R control) A+2 Last figure±1
R-UCL Upper control limit (R control) A+2 Last figure±1
R-LCL Lower control limit (R control) A+2 Last figure±1
IMPORTANT
Range to apply calculation error is revealed in the calculation error detail.