Browsing by Author "Serafi, Mohamad"

Now showing 1 - 1 of 1

Restricted
THE AFFECT OF FACIAL EXPRESSION ANIMATIONS IN SYSTEMS THAT INCORPORATES A VR
(Queen Mary University of London, 2024) Serafi, Mohamad; Healey, Patrick
Advances in the quality of virtual reality hardware and software mean that it is now possible to have real-time conversations using high fidelity avatars driven by live capture of facial expressions. Not all facial movements are captured or animated by current state-of-the-art systems. This raises two questions. First, which types of facial expressions are most important for effective communication? Second, how effectively are they reproduced by avatars and perceived by users? One especially important class of facial expressions for natural human interaction are those associated with communication of misunderstanding: ‘confused’ or ‘puzzled’ faces. To answer these questions a corpus of 9 facial expressions of confusion plus 5 baseline expressions are constructed using facial movement data captured from natural conversation. Each expression is then reconstructed using high quality avatars. The set of expressions are presented to users as 3D animations and participants judge whether they show confusion. Data on the type and speed of response and from live eye tracking show that all facial expressions were significant individual levels to predict pressing yes compared to fluent expression which we think is far from the confused facial expression. the direction of eyes or head roll didn’t make much.
14 0