Music-Originated Zeitgeist for Artistic Representation and Translation (MOZART): Distributed Agency in Music-to-Physical-Painting

MOZART is a multimodal system that transforms music into physical paintings. A dual-stream diffusion adapter conditions Stable Diffusion (SD) 1.5 on CLAP audio embeddings and music-theoretic interval vectors to generate a digital image and a stroke planner then decomposes this image into painting strokes, where acoustic energy is encoded as stroke intensity. The physical implementation is realized using a plotter (a Bambu Lab A1 3D printer) with control over spatial position and depth. Colored pencil is used as the painting medium because it allows both color and stroke intensity to be controlled through plotter z-axis pressure. This pipeline demonstrates distributed agency (model, machine, and material each exercise and constrain creative decisions) and shows that musical dynamics are measurable and translated into physical properties of marks on paper: louder passages produce heavier strokes (Pearson $r{=}+0.29$), consistent with the inner image having its own spatial logic rather than transcribing audio.