15
Relation of display and output data
1. Relation of display and output data
This product has 4-digit data of valid number of digits for all Y,
x, y inside and this 4-digit data are outputted.
(As to Y, in numeric value of lower than 10, numeric value up to
third decimal place is dealt.)
The display is 3 digits of valid number of digits, and displays
after [cutting off] the fourth digit of the internal data.
In the internal calculation, the valid number of digit is 4 digits by
rounding off. At this point, error of } 1 digit may be included.
Internal data, or relation of output data and display is as follows.
Yxy
Internal data 10.79 0.3346 0.3021
Display 10.7 0.334 0.302
2. Treatment of the valid digit in the color difference measurement.
(Difference of internal calculation and data output, display)
2.1 As to calculation of difference of Y value (
cc
cc
cY) in the color difference measurement
In the color difference calculation in this product, the output digit
number of calculated result of c Y changes depending on the size of
the Y value of the measured value and Y value of the target color.
The lowest valid digit of the color difference calculation result is
worked out matched with the lowest valid digit of bigger one of
either Y value of the measured value or Y value of the target color.
(At this point, the numeral is rounded off.)
The relation of Y value of the measured value, Y value of the target
color, internal data and display is as follows.
2.2
As to calculation of difference of chromaticity
cc
cc
c x,
cc
cc
c y in the color difference measurement
As to the difference of the chromaticity c x value, c y value, up
to the fourth decimal place of the fixed decimal form is worked out.
Y value of the measured
value (Internal data)
Y value of the target
color (Internal data)
Original color difference
calculation valueic Yj
Internal data
Display
Calculation example 1
Pattern that the valid
digit does not change.
Calculation example 2
Pattern that the valid
digit decreases.
Calculation example 3
Case(1)that the digit of the measured value
and the standard value are different
Calculation example 4
Case(2)that the digit of the measured value
and the target value are different
234.5 100.0 10240 1.000
100.0 102.3 293.4 10000
134.5 -2.3 9946.6 -9999
134.5 -2.3 9950 -10000
The first decimal place
is the lowest valid digit.
Therefore, the valid
digit number of the in-
ternal data is 2 digits.
The second digit (ten digits) is
the lowest valid digit, so the
first digit is rounded off and
the valid number of digit of the
internal data is 3 digits.
The second digit (ten digits) is
the lowest valid digit, so the
first digit is rounded off and
the valid number of digit of the
internal data is 3 digits.
134 -2 9900 -10000
To Next Page
Loading...
Need help?
General
