HD6432345 Datasheet, PDF (535/907 Pages) Hitachi Semiconductor – H8S/2345 F-ZTAT Hardware Manual

• Absolute precision
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.
Digital output
H'3FF
H'3FE
H'3FD
Ideal A/D conversion
characteristic
H'002
Quantization error
H'001
H'000
12
1024 1024
1022 1023 _FS
1024 1024
Analog
input voltage
Figure 14.9 A/D Conversion Precision Definitions (1)
522