Skip to yearly menu bar Skip to main content


CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders

Kevin Frans · Lisa Soros · Olaf Witkowski

Hall J (level 1) #928

Keywords: [ image synthesis ] [ CLIP ] [ Computer Vision ] [ language to text ] [ art ] [ creativity ]


CLIPDraw is an algorithm that synthesizes novel drawings from natural language input. It does not require any additional training; rather, a pre-trained CLIP language-image encoder is used as a metric for maximizing similarity between the given description and a generated drawing. Crucially, CLIPDraw operates over vector strokes rather than pixel images, which biases drawings towards simpler human-recognizable shapes. Results compare CLIPDraw with other synthesis-through-optimization methods, as well as highlight various interesting behaviors of CLIPDraw.

Chat is not available.