12-21
IM 04P01B01-01E
Specifications
12
Item Specifications
Measuring accuracy and recording accuracy in case of square root computation
A: Voltage measurement accuracy (digits)
B: Voltage span (digits)
C: Scaling span (digits, upper limit of scaling – lower limit of scaling)
Input Range Computed Value Accuracy Equation (Digits),
Rounded up to the decimal place
Recording Accuracy
0% or more, less than 1.5%
*
±(0.1 × C + 2) Left value + 0.3% of
recording span
1.5% or more, less than 6.25% ±(A / B × C × 5 + 2)
6.25% or more, less than 25% ±(A / B × C × 2 + 2)
25% or more, 100% or less ±(A / B × C + 2)
* Includes case when:
(input voltage – lower limit of the specified voltage range) / used range × 20000 < 256.
If the specified range is, for example, 1–5 V, the lower limit of the specified voltage range is 1.
Use a measurement range that is as close to the measurement span as possible.
Example: Assuming that
• range type: 6 V
• measuring span: 1.000 to 5.000 V
• scaling span: 0.000 to 2.000 Then,
A = A calculated value shown below
B = 5.000 V - 1.000 V = 4.000 V (4000 digits)
C = 2.000 – 0.000 = 2.000 (2000 digits)
<Measuringaccuracy>
(1) When the input is 1.24 V (6% input)
A = ± ( 0.1% × 1.240 V + 2 digits ) = ±( 0.00124 V(2 digits) + 2 digits ) = ±4 digits
Measuring accuracy = ± ( 4/4000 × 2000 × 5+2) = ±12 digits
(2) When the input is 5 V (100% input)
A = ± ( 0.1% × 5.000 V + 2 digits ) =±( 0.005 V(5 digits) + 2 digits ) = ±7 digits
Measuring accuracy = ± ( 7/4000 × 2000+2 )= ±5.5 = ±6 digits (rounded up)
<Recordingaccuracy>
Measuring accuracy± 0.3 mm (0.3% of 100 mm)
Reference junction compensation
Internal/External selectable for each channel
Reference junction compensation accuracy
Above 0°C with input terminal temperature balanced (60 minutes after power on)
Type R, S, B, W, WRe: ±1.0°C
Type K, J, E, T, N, L, U: ±0.5°C
Maximum input voltage ±10 VDC (continuous) for ranges of 200 mV or less, TC, RTD, and DI ranges
±60 VDC (continuous) for 2 VDC or higher ranges
Input resistance Approximately10MΩormoreforrangesof200mVorlessandTC
Approximately1MΩfor2VDCorhigherranges
Input source resistance Volt, TC: 2kΩorless
RTD input: 10Ωorlessperwire(Theresistanceofallthreewiresmustbeequal).
Bias current 10 nA or less (except when burnout detection function is enabled)
Common mode rejection ratio 120dB(50/60Hz±0.1%,500Ωunbalanced,betweentheminusterminalandground)
Normal mode rejection ratio
40 dB or more (50/60 Hz ± 0.1%)
Noise rejection By the integrating A/D converter: The integration time is 16.7 ms, 20 ms, or 100 ms (dot model)
Low-pass filtering (pen model): Filter time constant is 2 s, 5 s, or 10 s
Moving average (dot model): The number of samples is 2 to 16.
12.6 General Specifications