HD64F3670 Datasheet, PDF (226/305 Pages) Renesas Technology Corp – Hitachi Single-Chip Microcomputer

14.5 A/D Conversion Precision Definitions
This LSI's A/D conversion precision definitions are given below.
• Resolution
The number of A/D converter digital output codes
• Quantization error
The deviation inherent in the A/D converter, given by 1/2 LSB (see figure 14-4).
• Offset error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from the minimum voltage value 0000000000 to 0000000001
(see figure 14-5).
• Full-scale error
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from 1111111110 to 1111111111 (see figure 14-5).
• Absolute precision
The deviation between the digital value and the analog input value. Includes offset error, full-
scale error, quantization error, and nonlinearity error.
Digital output
Ideal A/D conversion
111
characteristic
110
101
100
011
010
Quantization error
001
000
1 2 3 4 5 6 7 FS
8 88 888 8
Analog
input voltage
Figure 14-4 A/D Conversion Precision Definitions (1)
Rev. 1.0, 03/01, page 202 of 280