SH7764 Datasheet, PDF (1131/1752 Pages) Renesas Technology Corp – Renesas 32-Bit RISC Microcomputer SuperHTM RISC Engine Family SH-4A Series

Section 23 G2D
Table 23.3 Setting Ranges of Parameters Set by Registers and Saturation Processing
Parameters Set by
Registers
Setting Range
Matrix parameters
A to I
−2¹⁵ ≤ Matrix parameters A to I < 2¹⁵
(IEEE 754 standard single-precision
floating-point)
Z clipping area and
Z saturation value
MIN
2^−16 ≤ Z clipping area, Z saturation
value MIN < 2¹⁵
(IEEE 754 standard single-precision
floating-point)
Coordinate
−2¹⁵ ≤ Coordinate transformation
transformation offset offset X, Y ≤ 2¹⁵ − 1
X, Y
(16-bit integer (two's complement))
Saturation Processing
When matrix parameters A to I ≥ 2¹⁵:
H'7FFF FFFF
When matrix parameters A to I < −2¹⁵:
−H'8000 0000
(32-bit fixed-point)
When Z clipping area, Z saturation
value MIN ≥ 2¹⁵: H'7FFF FFFF
When Z clipping area, Z saturation
value MIN < 2^−16: H'0000 0001
(32-bit fixed-point)

Table 23.4 Vertex Ranges after Operation and Saturation Processing
Vertex
Coordinates
after Operation
TX, TY, W
WC
Range
Saturation Processing
−H'7FFF FFFF ≤ TX, TY, W ≤ H'7FFF When TX, TY, W > H'7FFF FFFF:
FFFF
H'7FFF FFFF
(32-bit fixed-point)
When TX, TY, W < −H'7FFF FFFF:
−H'7FFF FFFF
(32-bit fixed-point)
Z saturation value MIN ≤ WC ≤ H'7FFF When WC < Z saturation value MIN: Z
FFFF
saturation value MIN
(32-bit fixed-point)
(32-bit fixed-point)
Rev. 1.00 Nov. 22, 2007 Page 1075 of 1692
REJ09B0360-0100