Strasbaugh Software Calibration Procedures
Version 4.0 - February 1998 10 - 5
FORMULAS USED IN SOFTWARE
CALIBRATION PROCEDURES
As shown below, the formulas used in the calibration procedures presented in
this chapter are always enclosed in boxes for ease in identification. In addition,
all calculated values are presented in all caps, and an example solution is
provided for each procedure.
SAMPLE FORMULA PRESENTATION
NEW = Current Value + OFFSET ADJUSTMENT
CALIBRATION
VALUE
Example:
NEW = - 34.325 + .25
CALIBRATION
VALUE
NEW = - 34.075
CALIBRATION
VALUE
FRACTION/DECIMAL INCH CONVERSION TABLE
The table below provides fraction to decimal conversion values for inches to aid
in making the calculations required for software calibration.
Figure 10-1 Fraction/Decimal Inch Conversion Table
FRACTION/DECIMAL INCH CONVERSION TABLE
Fraction Decimal_
1/2 in. .5 in.
1/4 in. .25 in.
1/8 in. .125 in.
3/8 in. .375 in.
1/16 in. .0625 in.
7/16 in. .438 in.
1/32 in. .03125 in.
To Next Page
Loading...
