Immersive AI-Assisted Music Composition and Performance in Virtual and Mixed Reality

We present an immersive multiplayer system for the Meta Quest platform that enables new modes of music composition and performance through the integration of virtual reality (VR), mixed reality (MR), and artificial intelligence (AI). Built in Unity, the system allows multiple players to interact in shared VR worlds or real physical environments via passthrough. Musical elements are represented as tangible objects within these environments, making sound directly manipulable. AI-assisted instruments extend creative possibilities by enabling prompt-based sound generation, real-time audio synthesis, and automatic transformation of existing MIDI clips into new material. Musical elements are hierarchically structured: sounds can be grouped into palettes, combined into movements, and ultimately assembled into full compositions. This system introduces a novel paradigm for collaborative, embodied, and AI-augmented music creation.