AugTwins

AugTwins is a pipeline for creating interactive human digital twins that engage users in natural, face-to-face conversation. By integrating photorealistic embodiment (Unreal Engine MetaHuman), voice cloning, and a hybrid multi-agent memory architecture, the system enables realistic encounters with digital representations of real people. Each twin is grounded in the person’s life story, experiences, and knowledge while maintaining conversational continuity across sessions. The architecture combines fast pattern matching for common queries with deep semantic retrieval for biographical details, coordinated through metacognitive monitoring that guides socially appropriate responses. We present two deployed twins demonstrating faithful personality representation and accurate biographical recall. Beyond technical implementation, AugTwins invites reflection on how memory and embodiment shape identity, and what it means to extend human presence through computational reconstruction.