chapter1 计算机1

– EMOTE (Expressive MOTion Engine)
• Other: USC, NYU, F2F, Sony…
9
BEAT
• Advantages: – Currently the most satisfying animation toolkit that automatically extracts actual linguistic and contextual information from text to suggest appropriate hand and arm gestures, facial expressions, and intonation of voice – Allows animators to insert their preferred personalities, motion characteristics, or other particular features in the final animation • Disadvantages: – The imperfect computational linguistics is the greatest limitation in BEAT’s current version – Only performs for English input
14
Social Context Ontology (SCO)
• Associate the social context with an ordinary avatar - culture ontology, profession ontology, family ontology, religion ontology – Definition: a set of ontology elements {Ψi | i = 1, …, n}, where Ψi = < vi, R’i, Ii, Idi > – Relationship Generalization - Φgeneralization (Asian, Japanese) Disjoint - Φdisjoint (teacher, student) – Extension Mechanism: change/adapt the existing ontology or introduce a new ontology
2
When We Need to Make a Presentation
• Usually we need to present our research in a regular seminar or at a conference.
3
What is the Clear Structure of a Presentation
PART 1 METHODOLOGIES & SKILLS
Chapter 1 How to Make a Research Presentation
1
Think About…
When do you need to make a research presentation? Have you ever had an experience of making a presentation? How do you feel about it? What is the common structure of a presentation? And which parts are important and must be explained clearly? What should you pay attention to when you give a presentation? Is there anything else that you think is also important but has not been mentioned in the textbook for a presentation?
10
EMOTE
• Advantages: – Offers a methodological tool for creating personalized agents, which provides a method of synthesizing movements by controlling a relatively small number of parameters, and enables a higher level of understanding communicative gestures – Acquire gestures with emphasis on arm and body postures that are largely neglected by other systems • Disadvantages: – Not provide an effective and easy-to-use tool for addressing the social context for avatars – Not consider multilingual input
15
Client-Server Topology
Client
SCO Profile User Interface VRML Browser
Query
ຫໍສະໝຸດ Baidu
SCO
HTML File VRML File
Common Gateway Interface (CGI)
Semantic Feature Extraction
• Title of the presentation/name/affiliation of the author • Outline • Why/What you want to do • Prior art /related work/ what’s new • How to do • Results • Evaluation: contributions/advantages/limitations • Applications/recommendations • Conclusion/future work 4
Sample:
Social Avatar Language for Natural Avatar-Based Human Communication
Dr. Jin Hou Southwest Jiaotong University
5
Outline
• • • • • What and Why we want to do Related work and challenges Our approach Result Conclusion and future work
8
What Has Been Done with Avatars
• MIT Media Lab, Justine Cassell group
– BEAT (Behavior Expression Animation Toolkit)
• Pennsylvania Univ., Norman I. Badler group
11
What’s New in Our Study
• New conception: SAL to reflect the social background of an avatar • Emphasis on cultural factor: Japanese, Chinese, American • Including body movement, facial expressions with appropriate eyes, eyebrows, and mouth movements
12
Our Approach - Ontology + VRML
• VRML-based H-Anim Humanoid • Ontology Model – Avatar Modeling Ontology (AMO): puts the anatomic constraints on avatar animation – Social Context Ontology (SCO): associates the social context with avatars
7
Challenges
• Where is the avatar from? • What is the personality of the avatar? • Body movement is mostly neglected and not synchronized with the face • Commercial products are available but usually rely on the pre-authored audio
Mapping Manager
Server
Retrieval
Database
Character DB Keyword DB SCO DB Transform DB Animation DB
16
Flow Chart of Animation Synthesis
Input
Natural Language Processing SCO DB
6
Social Avatar Language (SAL)
• Avatar? – Graphical representation of a real person in a virtual environment • SAL? – Avatars’ nonverbal language in terms of social context • Why SAL? – Our behaviors are influenced by social factors such as culture, profession, religion… • Purpose! – Natural, sociable, personalized avatars
Keyword DB
Avatar Word
Transform DB Character DB Animation DB
VRML Animation Synthesis
HTML Generation
Output
17
私(は)正座(しています) (I am sitting on my heels)
18
我去游泳 (I go swimming)
13
Avatar Modeling Ontology (AMO)
• Define meta-elements (segment, joint…), and further elements like body parts (arm, leg…) and facial expressions (happiness, fear, disgust…) – Identity: distinguishes an entity from the others in terms of geometry, appearance, texture, color and so on – Dependency: describes all of the relationships an entity has, e.g. the upper arm adjoins the forearm
19
I Go Swimming
20
Facial Animation
21
Application（1）
• Graphical chat
22
Graphical Chat
• Display concepts that would be very difficult to explain verbally to people from different cultures, such as “seiza” in Japan, or Tai Chi in China • A tool for enhancing international understanding across cultural barriers by using both verbal and nonverbal channels • Current spoken language machine translations are not satisfying, our SAL can supplement machine translation and improve understanding through providing a visual aid