Accuracy calculations
The information below discusses how to calculate output, readback, and digital voltmeter
input accuracy.
Output and compliance accuracy
Output and compliance accuracy are calculated as follows:
Accuracy = ±(% of output + offset)
As an example of how to calculate the actual output limits, assume the Model 2303, 2303B,
or 2303-PJ is sourcing 10V. Compute the output range from output voltage accuracy specifica-
tions as follows:
Accuracy = ±(% of output + offset)
= ±[(0.05%
×
10V) + 10mV]
= ±(5mV + 10mV)
= ±15mV
Thus, the actual output voltage range is: 10V± 15mV, or from 9.985V to 10.015V.
Current compliance calculations are performed in exactly the same manner using the perti-
nent specifications and compliance current settings.
Readback accuracy
Readback accuracy is calculated similarly, except of course that voltage or current readback
specifications are used. As an example of how to calculate the actual current readback limits,
assume the actual current being measured is 1.5A. Using the 5A range current readback speci-
fications, the current readback reading range is:
Accuracy = ±(0.2% of reading + 400
µ
A offset)
= ±[(0.2%
×
1.5A) + 200
µ
A)]
= ±(3mA + 400
µ
A)
= ±3.4mA
In this case, the actual current readback reading range is: 1.5A ±3.2mA, or from 1.4968A to
1.5032A.
Digital voltmeter input accuracy
Accuracy of the digital voltmeter can be computed in exactly the same manner. Use the digital
voltmeter input accuracy specifications and the applied voltage in your calculations. For exam-
ple, assume that 5V is applied to the digital voltmeter input. Reading range is:
Accuracy = ±(% of reading + offset)
= ±[(0.05%
×
5V) + 10mV]
= ±(2.5mV + 10mV)
= ±12.5mV
The reading range is 5V ±12.5mV, or from 4.988V to 5.012V.
A-6 Specifications