OSW

SIGNATURE WORK
CONFERENCE & EXHIBITION 2023

FaceVR: a Technique Synthesizing an Avatar’s Upper Facial Expression Based on a User’s Lower Face Movements

Name

Yutong Ren

Major

Data Science

Class

2023

About

The E-portfolio includes a poster and a video presentation of my signature work. The video also included a short clip of the proposed technique's demo

Signature Work Project Overview

In this signature work, I studied the upper facial expression of an avatar in a social VR scenario. I did two pilot studies on how an avatar’s upper facial expression affects emotion recognition and naturalness. Then I implemented a unique technique of synthesizing an avatar’s upper facial expression based on a user’s lower face movements. In addition, I also conducted a usability test to evaluate its performance. Results revealed that it has enormous potential to be popularized and suit different scenarios and be used for different needs in social VR communication.

Signature Work Presentation Video