Mitutoyo DP-1VA LOGGER - Calculation Specifications; Effective Digits

To Next Page

To Previous Page

7Specications

No. 99MAM029A

7.2

CalculationSpecications

7.2.1 Effective Digits

The essential gures for calculation are as follows.

Setting the effective digits (number of digits after the decimal point) of input data as A,

the effective digits of each case are shown.

Symbol Meaning

Displayed effective dig-

its (after the decimal

point)

Tolerance

Data Input data A -

N Number of data - -

MAX Maximum value A -

MIN Minimum value A -

R Range A -

X Average A + 2 Lowermost digit ±1

σn Standard deviation A + 2 Lowermost digit ±1

σn-1 Sample standard deviation A + 2 Lowermost digit ±1

P Fraction defective (%) 3 Lowermost digit ±1

Cp Process capability index 3 Lowermost digit ±1

Cpk Process capability index 3 Lowermost digit ±1

LSL Lower specication limit value A Lowermost digit ±1

USL Upper specication limit value A Lowermost digit ±1

DIV

Number of divisions in histogram

Fixed to 10 divisions -

Histogram range display A + 2 Lowermost digit ±1

X¯ Center (X¯ control) A + 2 Lowermost digit ±1

X¯ - U C L Upper control limit (X¯ control) A + 2 Lowermost digit ±1

X¯ - L C L Lower control limit (X¯ control) A + 2 Lowermost digit ±1

R¯ Center (R control) A + 2 Lowermost digit ±1

R¯ - U C L Upper control limit (R control) A + 2 Lowermost digit ±1

R¯ - L C L Lower control limit (R control) A + 2 Lowermost digit ±1