207
Measurement Range and Accuracy
10.6 Measurement Range and Accuracy
Measurement accuracy equation: Measurement accuracy is calculated using the following equation.
Measurement accuracy = Basic accuracy × C × D × E × F × G
C: Level coefcient, D: Measurement speed coefcient, E: Cable length coefcient,
F: DC bias coefcient, G: Temperature coefcient (operating temperature coefcient)
Basic accuracy
Accuracy is calculated based on coefcients A and B from the basic accuracy chart shown below.
(See "Example calculation of basic accuracy" (p. 209).)
1 kΩ range or higher Basic accuracy =
10
1
Zx
A B
×
± + × −
Range
100 Ω range or lower Basic accuracy =
1A B
Zx
± + × −
Range
Zx
: Impedance of the measurement sample
A and B: Noted in basic accuracy chart. (Upper value:
Z
accuracy [% rdg.]; lower value:
θ
accuracy [°])
• From 1.0001 MHz to 5 MHz, multiple basic accuracy by (fm [MHz]+3)/4.
*
• From 5.0001 MHz to 8 MHz, multiple basic accuracy by fm [MHz]/2.
*
*: "fm" is measurement frequency [MHz].
Basic accuracy chart
Range
For DC
measurement
For AC measurement (measurement frequency)
4 Hz to 99.99 Hz 100.00 Hz to 999.99 Hz 1.0000 kHz to 10.000 kHz
100 M
Ω
A=1 B=1
A=6 B=5 A=3 B=2 A=3 B=2
A=5 B=3 A=2 B=2 A=2 B=2
10 M
Ω
A=0.5 B=0.3
A=0.8 B=1 A=0.5 B=0.3 A=0.5 B=0.3
A=0.8 B=0.5 A=0.4 B=0.2 A=0.4 B=0.2
1 M
Ω
A=0.2 B=0.1
A=0.4 B=0.08 A=0.3 B=0.05 A=0.3 B=0.05
A=0.3 B=0.08 A=0.2 B=0.02 A=0.2 B=0.02
100 k
Ω
A=0.1 B=0.01
A=0.3 B=0.03 A=0.2 B=0.03 A=0.2 B=0.03
A=0.2 B=0.02 A=0.1 B=0.02 A=0.1 B=0.02
10 k
Ω
A=0.1 B=0.01
A=0.3 B=0.03 A=0.2 B=0.02 A=0.05 B=0.02
A=0.2 B=0.02 A=0.1 B=0.02 A=0.03 B=0.02
1 k
Ω
A=0.1 B=0.01
A=0.3 B=0.02 A=0.2 B=0.02 A=0.2 B=0.02
A=0.2 B=0.01 A=0.1 B=0.02 A=0.1 B=0.02
100
Ω
A=0.1 B=0.02
A=0.3 B=0.02 A=0.2 B=0.02 A=0.2 B=0.02
A=0.2 B=0.01 A=0.15 B=0.01 A=0.1 B=0.01
10
Ω
A=0.2 B=0.15
A=0.5 B=0.1 A=0.4 B=0.05 A=0.4 B=0.05
A=0.3 B=0.1 A=0.3 B=0.03 A=0.3 B=0.03
1
Ω
A=0.3 B=0.3
A=1.5 B=1 A=1 B=0.3 A=1 B=0.3
A=0.8 B=0.5 A=0.5 B=0.2 A=0.5 B=0.2
100 m
Ω
A=1 B=1
A=8 B=8 A=5 B=4 A=3 B=2
A=5 B=4 A=3 B=2 A=2 B=1.5
10
Specications