OSW

SIGNATURE WORK
CONFERENCE & EXHIBITION 2024

Hanxizai VR: Exploring Interactive LLM-Driven NPCs in Storytelling in Virtual Reality (VR) Environment

Name

Weicheng Zheng

Major

Data Science

Class

2024

About

On Jerry Zheng's academic transcript, he is a Data Science major student. In his mind, he is a HCI researcher. But in his heart, he is a gamer.

Signature Work Project Overview

HanXizai VR ventures into the innovative confluence of Large Language Models (LLMs) and Virtual Reality (VR) to transform storytelling through dynamic Non-Playable Characters (NPCs). This project, inspired by the historical narrative “The Night Revels of Han Xizai,” employs GPT technology to craft immersive, historically accurate VR experiences. By simulating intelligent, interactive NPCs with LLMs, the endeavor not only augments player engagement and narrative depth but also fosters a collaborative storytelling process that is both educational and entertaining. The development and implementation of this narrative game, grounded in meticulous historical research and cutting-edge AI technology, introduces a new paradigm in interactive storytelling. The exploratory design approach of the study reveals how LLM-driven NPCs can dynamically alter game states, engage in grounded conversations, and execute contextually relevant actions, thereby significantly advancing the field of digital narrative experiences. The principal findings underscore the project’s success in enhancing understanding and appreciation of historical content, demonstrating the potential of AI to revolutionize narrative design and VR gaming. This work stands as a testament to the synergy between historical storytelling and advanced AI, offering a fresh lens through which to view and interact with the past.

Signature Work Presentation Video