Timezone: »

Machine Learning for Creativity and Design 4.0
Luba Elliott · Sander Dieleman · Adam Roberts · Tom White · Daphne Ippolito · Holly Grimm · Mattie Tesfaldet · Samaneh Azadi

Sat Dec 12 05:15 AM -- 03:00 PM (PST) @ None
Event URL: https://neurips2020creativity.github.io/ »

Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN2, Jukebox and GPT-3. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to replicating artistic work. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.

Sat 5:15 a.m. - 5:30 a.m.
Introduction and Art Gallery Overview (Introduction) Video
Luba Elliott
Sat 5:30 a.m. - 6:30 a.m.
Poster Session 1 (Poster Session)
Sat 6:30 a.m. - 6:56 a.m.
Farewell to Fart: Working with generated text in the age of huge neural nets (Invited Talk) Video
Janelle Shane
Sat 6:56 a.m. - 7:21 a.m.
Artist+AI: Figures&Form (Invited Talk) Video
Scott Eaton
Sat 7:21 a.m. - 7:40 a.m.
Artificial biodiversity (Invited Talk) Video
Sofia Crespo
Sat 7:40 a.m. - 8:00 a.m.
Art Showcase 1 (Break) Video
Luba Elliott
Sat 8:00 a.m. - 8:30 a.m.
Panel Discussion 1 (Panel Discussion)
Luba Elliott, Janelle Shane, Sofia Crespo, Scott Eaton, Adam Roberts, Angela Fan
Sat 8:30 a.m. - 9:15 a.m.
Social 1 (Social)
Sat 9:15 a.m. - 9:46 a.m.
magenta: Empowering Creative Agency with Machine Learning (Invited Talk) Video
Jesse Engel
Sat 9:46 a.m. - 10:20 a.m.
Art Showcase 2 (Break) Video
Holly Grimm
Sat 10:20 a.m. - 10:47 a.m.
Computation and the Human Visual Perception of Art (Invited Talk) Video
Aaron Hertzmann
Sat 10:47 a.m. - 11:09 a.m.
LIGHT: Language in Games with Humans and Text (Invited Talk) Video
Angela Fan
Sat 11:09 a.m. - 11:35 a.m.
Not the Only One (Invited Talk) Video
Stephanie Dinkins
Sat 11:35 a.m. - 11:50 a.m.
Art Showcase 1 (Break) Video
Luba Elliott
Sat 11:50 a.m. - 12:00 p.m.
Audio-reactive Latent Interpolations with StyleGAN (Contributed Talk) Video
Hans Brouwer
Sat 12:00 p.m. - 12:10 p.m.
Towards realistic MIDI instrument synthesizers (Contributed Talk) Video
Rodrigo Castellon
Sat 12:10 p.m. - 12:20 p.m.
Creative Sketch Generation (Contributed Talk) Video
Songwei Ge
Sat 12:20 p.m. - 12:30 p.m.
Agence: an interactive film exploring multi-agent systems and human agency (Contributed Talk) Video
Dante Camarena
Sat 12:30 p.m. - 12:45 p.m.
Art Showcase 2 (Break) Video
Holly Grimm
Sat 12:45 p.m. - 1:45 p.m.
Poster Session 2 (Poster Session)
Sat 1:45 p.m. - 2:15 p.m.
Panel Discussion 2 (Panel Discussion)
Tom White, Jesse Engel, Aaron Hertzmann, Stephanie Dinkins, Holly Grimm
Sat 2:15 p.m. - 3:00 p.m.
Social 2 (Social)
Latent Space Oddity: Exploring Latent Spaces to Design Guitar Timbres (Poster) [ Video ] Video
Jason Taylor
Colorization Transformer (Poster) [ Video ] Video
Manoj Kumar
Diptychs of human and machine perceptions (Poster) [ Video ] Video
Vivien Cabannes
GANterpretations (Poster) [ Video ] Video
Pablo Samuel Castro
Generating Novel Glyph without Human Data by Learning to Communicate (Poster) [ Video ] Video
Seung-won Park
Text to Dialog: Using Semantic Similarity to Extend Narrative Immersion in Virtual Worlds (Poster) [ Video ] Video
Sherol Chen
TräumerAI: Dreaming Music with StyleGAN (Poster) [ Video ] Video
Dasaem Jeong
Weird AI Yankovic: Generating Parody Lyrics (Poster) [ Video ] Video
Mark Riedl
White-box Audio VST Effect Programming (Poster) [ Video ] Video
Christopher Mitcheltree
A Note on Data Biases in Generative Models (Poster) [ Video ] Video
Patrick Esser
Horses With Blue Jeans - Creating New Worlds by Rewriting a GAN (Poster) [ Video ] Video
David Bau
Latent Compass (Poster) [ Video ] Video
Sarah Schwettmann
Transformer-GAN: Symbolic music generation using a learned loss (Poster) [ Video ] Video
aashiq Muhamed
Choreo-Graph: Learning Latent Graph Representations of the Dancing Body (Poster) [ Video ] Video
Mariel Pettee
LiveGAN (Poster) [ Video ] Video
Cameron Smith
Randomized Overdrive Neural Networks (Poster) [ Video ] Video
Christian Steinmetz
Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains (Poster) [ Video ] Video
Justin Pinkney
A Framework and Dataset for Abstract Art Generation via CalligraphyGAN (Poster) [ Video ] Video
Jinggang Zhuo
Mask-Guided Discovery of Semantic Manifolds in Generative Models (Poster) [ Video ] Video
Mengyu Yang
Network Bending Neural Vocoders (Poster) [ Video ] Video
Louis McCallum
Copyspace: Where to Write on Images (Poster) [ Video ] Video
Jessica Lundin
Musical Diary - AI Application for Music Making and Journaling (Poster) [ Video ] Video
Suyash Joshi
Painting from Music using Neural Visual StyleTransfer (Poster) [ Video ] Video
Prateek Verma, Ingrid Odlen, pamela Davis kivelson, Constantin Basica
Spatial Assembly:Generative Architecture With Reinforcement Learning, Self Play and Tree Search (Poster) [ Video ] Video
Panagiotis Tigas
Behaviour Aesthetics of Reinforcement Learning in a Robotic Art Installation (Poster) [ Video ] Video
Sofian Audry, Rosalie D Gagne, Hugo Scurto
A Speech-Based Music Composition Tool with Transformer (Poster) [ Video ] Video
Jason d'Eon
Image Generation With Neural Cellular Automatas (Poster) [ Video ] Video
Mingxiang Chen
Neural Style Transfer for Casual Creation (Poster) [ Video ] Video
Simon Colton

Author Information

Luba Elliott (elluba.com)

Luba Elliott is a curator, artist and researcher specialising in artificial intelligence in the creative industries. She is currently working to educate and engage the broader public about the latest developments in creative AI through monthly meetups, talks and tech demonstrations. As curator, she organised workshops and exhibitions on art and AI for The Photographers’ Gallery, the Leverhulme Centre for the Future of Intelligence and Google. Prior to that, she worked in start-ups, including the art collector database Larry’s List. She obtained her undergraduate degree in Modern Languages at the University of Cambridge and has a certificate in Design Thinking from the Hasso-Plattner-Institute D-school in Potsdam.

Sander Dieleman (DeepMind)
Adam Roberts (Google Brain)
Tom White (Victoria University of Wellington School of Design)

Tom is a New Zealand based artist investigating machine perception. His current work focuses on creating physical artworks that highlight how machines “see” and thus how they think, suggesting that these systems are capable of abstraction and conceptual thinking. He has exhibited computer based artwork internationally over the past 25 years with themes of artificial intelligence, interactivity, and computational creativity. He is currently a lecturer and researcher at University of Wellington School of Design where he teaches students the creative potential of computer programming and artificial intelligence.

Daphne Ippolito (University of Pennsylvania / Google)

I am a PhD student at the University of Pennsylvania working in natural language processing. I am co-advised by Chris Callison-Burch at UPenn and Doug Eck at Google.

Holly Grimm (Sustia LLC)

Diné (Navajo) artist and machine learning engineer with interests in generative art and natural language processing for Indigenous languages. OpenAI Scholar. Creative Technologist at Google Artists + Machine Intelligence.

Mattie Tesfaldet (McGill University & Mila)
Samaneh Azadi (UC Berkeley)

More from the Same Authors