System and method for real time lip synchronizatio
- 1、下载文档前请自行甄别文档内容的完整性，平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益，请联系客服反馈,我们会尽快为您处理(人工客服工作时间：9:00-18:30)。
专利名称：System and method for real time lip
synchronization
发明人：Ying Huang,Stephen Ssu-te Lin,Baining
Guo,Heung-Yeung Shum
申请号：US11435122
申请日：20060516
公开号：US20060204060A1
公开日：
20060914
专利内容由知识产权出版社提供
专利附图：
摘要：A novel method for synchronizing the lips of a sketched face to an input voice.The lip synchronization system and method approach is to use training video as much as
possible when the input voice is similar to the training voice sequences. Initially, face sequences are clustered from video segments, then by making use of sub-sequence Hidden Markov Models, a correlation between speech signals and face shape sequences is built. From this re-use of video, the discontinuity between two consecutive output faces is decreased and accurate and realistic synthesized animations are obtained. The lip synchronization system and method can synthesize faces from input audio in real-time without noticeable delay. Since acoustic feature data calculated from audio is directly used to drive the system without considering its phonemic representation, the method can adapt to any kind of voice, language or sound.
申请人：Ying Huang,Stephen Ssu-te Lin,Baining Guo,Heung-Yeung Shum
地址：Beijing CN,Beijing CN,Beijing CN,Beijing CN
国籍：CN,CN,CN,CN
更多信息请下载全文后查看