【WO2019221979A1】用于HMD环境中的快速有凹渲染的具有预测和对GPU的后期更新的眼睛跟

2207 Bridgepointe Pkwy., San Mateo, CA 94404 (US).
(21) International App) Inventor: FERNANDEZ RICO, Javier; 2207 Bridge¬
PCT/US20 19/03 1206
Drive, Suite 200, Sunnyvale, CA 94085 (US).
(25) Filing Language:
English
(26) Publication Language:
English
(30) Priority Data:
15/982,3 12
17 May 2018 (17.05.2018)
[Continued on next page]
W O 2019/221979 A 1
SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW.
(84) Designated States (unless otherwise indicated, for every kind of regional protection available) : ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, Cl, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG).
)
(
2
(51) International Patent Classification:
G09G 5/37 (2006.0 1)
G09G 5/391 (2006.0 1)
G06F 3/01 (2006.0 1)
G09G 5/393 (2006.0 1)
(72) Inventor; and (71) Applicant (for US only): YOUNG, Andrew [US/US];
pointe Pkwy., San Mateo, CA 94404 (US).
(22) International Filing Date:
(74) Agent: HSU, Lin, C. et al.; Penilla IP, APC, 710 Lakeway
07 May 2019 (07.05.2019)
(54) Title: EYE TRACKING WITH PREDICTION AND LATE UPDATE TO GPU FOR FAST FOVEATED RENDERING IN AN HMD ENVIRONMENT
SACCADE PREDICTION WITH LATE UPDATE
(57) Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.
US
(71) Applicant: SONY INTERACTIVE ENTERTAIN¬ MENT INC. [JP/JP]; 1-7-1 Konan, Minato-Ku, Tokyo 108-0075 (JP).
(81) Designated States (unless otherwise indicated, for every kind of national protection av ailable) . AE, AG, AL, AM, AO, AT, AU, AZ , BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA,