Towards AI Rapper: Creating an Interactive Rap Battle Experience with Generative AI

This demo lets you experience a real-time rap battle between a human and AI or two AI opponents. We develop an end-to-end solution that creates an interactive rap battle experience, leveraging multiple data modalities and ML models. Our system integrates speech recognition, emotion detection, language modeling, vision, text-to-speech, and voice cloning. The system combines multiple models to process user input across different modalities, generates appropriate and contextually-aware text and synthesizes audio responses. This demo demonstrates the potential of AI systems in creative music applications and offers insights into challenges and opportunities associated with integrating AI systems for interactive entertainment.