CALIBRATION
5-11
Amplitude Calbytes Amplitude Calbyte Numbers 0 thru 94
Range 0 - 255 (1 byte)
Amplitude Calbyte Organization
Frequency
Amplitude 100 Hz 120 Hz 1 kHz 10 kHz 100 kHz
0.10V 0 1 2 3 4
0.15V 5 6 7 8 9
0.20V 10 11 12 13 14
0.25V 15 16 17 18 19
0.30V 20 21 22 23 24
0.35V 25 26 27 28 29
0.40V 30 31 32 33 34
0.45V 35 36 37 38 39
0.50V 40 41 42 43 44
0.55V 45 46 47 48 49
0.60V 50 51 52 53 54
0.65V 55 56 57 58 59
0.70V 60 61 62 63 64
0.75V 65 66 67 68 69
0.80V 70 71 72 73 74
0.85V 75 76 77 78 79
0.90V 80 81 82 83 84
0.95V 85 86 87 88 89
1.00V 90 91 92 93 94
Floating Point Floating Point Calbyte Numbers 0 thru 120
Calbytes
Number Name
Meaning
0 Frequency Correction deviation from nominal, in ppm
1-40 Reference Resistor Values impedance values organized in
real & imaginary pairs
41-80 Open Circuit Values admittance values organized
as real & imaginary pairs
81-120 Short Circuit Values impedance values organized in
real & imaginary pairs