Skip to yearly menu bar Skip to main content


Workshop

NeurIPS 2023 Workshop on Diffusion Models

Bahjat Kawar ⋅ Valentin De Bortoli ⋅ Charlotte Bunne ⋅ James Thornton ⋅ Jiaming Song ⋅ Jong Chul Ye ⋅ Chenlin Meng
Project Page

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
6:50 AM
Opening Remarks
8:00 AM
Coffee Break
10:00 AM
Lunch
12:30 PM
LC-SD: Realistic Endoscopic Image Generation with Stable Diffusion and ControlNet
Joanna Kaleta ⋅ Diego Dall'Alba ⋅ Szymon Plotka ⋅ Przemyslaw Korzeniowski
12:40 PM
Manifold Diffusion Fields
Ahmed Elhag ⋅ Yuyang Wang ⋅ Joshua Susskind ⋅ Miguel Angel Bautista
12:50 PM
The Emergence of Reproducibility and Consistency in Diffusion Models
Huijie Zhang ⋅ Jinfan Zhou ⋅ Yifu Lu ⋅ Minzhe Guo ⋅ Liyue Shen ⋅ Qing Qu
1:00 PM
Coffee Break
EDGE++: Improved Training and Sampling of EDGE
Xiaohui Chen ⋅ Mingyang Wu ⋅ Liping Liu
Controllable Music Production with Diffusion Models and Guidance Gradients
Mark Levy ⋅ Bruno Di Giorgi ⋅ Floris Weers ⋅ Angelos Katharopoulos ⋅ Tom R Nickson
Effective Quantization for Diffusion Models on CPUs
Hanwen Chang ⋅ Haihao Shen ⋅ Yiyang Cai ⋅ Xinyu Ye ⋅ Zhenzhong Xu ⋅ Wenhua Cheng ⋅ Weiwei Zhang ⋅ Yintong Lu ⋅ Heng Guo
Staged Diffusion Models with Analytically Designed Hyperparameters
Kanad Pardeshi ⋅ Shrey Singla ⋅ Sunita Sarawagi
VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
Paul Couairon ⋅ Clément Rambour ⋅ Jean-Emmanuel HAUGEARD ⋅ Nicolas THOME
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
Dongjun Kim ⋅ Chieh-Hsin Lai ⋅ Wei-Hsiang Liao ⋅ Naoki Murata ⋅ Yuhta Takida ⋅ Toshimitsu Uesaka ⋅ Yutong He ⋅ Yuki Mitsufuji ⋅ Stefano Ermon
Learning from Invalid Data: On Constraint Satisfaction in Generative Models
Giorgio Giannone ⋅ Lyle Regenwetter ⋅ Akash Srivastava ⋅ Dan Gutfreund ⋅ Faez Ahmed
Beyond Generation: Exploring Generalization of Diffusion Models in Few-shot Segmentation
Jie Liu ⋅ TAO HU ⋅ Jan-jakob Sonke ⋅ Efstratios Gavves
Improving Discrete Diffusion Models via Structured Preferential Generation
Severi Rissanen ⋅ Markus Heinonen ⋅ Arno Solin
Decoding the Seeing Brain: Reconstructing Images and Text from fMRI Recordings with multimodal diffusion models
Matteo Ferrante ⋅ Tommaso Boccato ⋅ Furkan Ozcelik ⋅ Rufin VanRullen ⋅ Nicola Toschi
Fast Sampling via De-randomization for Discrete Diffusion Models
Zixiang Chen ⋅ Angela Yuan ⋅ Yongqian Li ⋅ Yiwen Kou ⋅ Junkai Zhang ⋅ Quanquan Gu
Diffusion models for probabilistic programming
Simon Dirmeier ⋅ Fernando Perez-Cruz
AlphaFold Meets Flow Matching for Generating Protein Ensembles
Bowen Jing ⋅ Bonnie Berger ⋅ Tommi Jaakkola
SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions
Yuseung Lee ⋅ Kunho Kim ⋅ Hyunjin Kim ⋅ Minhyuk Sung
Retrofitting 2D Latent Diffusion for Controllable Face Image Generation
Weihao Xia ⋅ Cengiz Oztireli ⋅ Jing-Hao Xue
IterInv: Iterative Inversion for Pixel-Level T2I Models
Chuanming Tang ⋅ kai wang ⋅ Joost van de Weijer
Investigating the Adversarial Robustness of Density Estimation Using the Probability Flow ODE
Marius Arvinte ⋅ Cory Cornelius ⋅ Jason Martin ⋅ Nageen Himayat
Towards Fast Stochastic Sampling in Diffusion Generative Models
Kushagra Pandey ⋅ Maja Rudolph ⋅ Stephan Mandt
Motion Flow Matching for Efficient Human Motion Synthesis and Editing
TAO HU ⋅ Wenzhe Yin ⋅ Pingchuan Ma ⋅ Yunlu Chen ⋅ Basura Fernando ⋅ Yuki M Asano ⋅ Efstratios Gavves ⋅ Pascal Mettes ⋅ Björn Ommer ⋅ Cees Snoek
Improved Convergence of Score-Based Diffusion Models via Prediction-Correction
Francesco Pedrotti ⋅ Jan Maas ⋅ Marco Mondelli
You Only Submit One Image to Find the Most Suitable Generative Model
Zhi Zhou ⋅ Lan-Zhe Guo ⋅ Pengxiao Song ⋅ Yu-Feng Li
Denoising Heat-inspired Diffusion with Insulators for Collision Free Motion Planning
Junwoo Chang ⋅ Hyunwoo Ryu ⋅ Jiwoo Kim ⋅ Soochul Yoo ⋅ Joohwan Seo ⋅ Nikhil Potu Surya Prakash ⋅ Jongeun Choi ⋅ Roberto Horowitz
DiffEnc: Variational Diffusion with a Learned Encoder
Beatrix M. G. Nielsen ⋅ Anders Christensen ⋅ Andrea Dittadi ⋅ Ole Winther
Beyond U: Making Diffusion Models Faster & Lighter
Sergio Calvo Ordoñez ⋅ Jiahao Huang ⋅ Lipei Zhang ⋅ Guang Yang ⋅ Carola-Bibiane Schönlieb ⋅ ANGELICA I AVILES-RIVERO
Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation
zihao wang ⋅ YINGYU YANG ⋅ Yuzhou Chen ⋅ Tingting Yuan ⋅ Maxime Sermesant ⋅ Herve Delingette ⋅ Ona Wu
Harmonic Prior Self-conditioned Flow Matching for Multi-Ligand Docking and Binding Site Design
Hannes Stärk ⋅ Bowen Jing ⋅ Regina Barzilay ⋅ Tommi Jaakkola
Sharp analysis of learning a flow-based generative model from limited sample complexity
Hugo Cui ⋅ Eric Vanden-Eijnden ⋅ Florent Krzakala ⋅ Lenka Zdeborová
Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective
Davide Ghio ⋅ Yatin Dandi ⋅ Florent Krzakala ⋅ Lenka Zdeborová
Circumventing Concept Erasure Methods For Text-to-Image Generative Models
Minh Pham ⋅ Kelly Marshall ⋅ Niv Cohen ⋅ Govind Mittal ⋅ Chinmay Hegde
Latent Diffusion for Document Generation with Sequential Decoding
Zihuiwen Ye ⋅ Elle Michelle Yang ⋅ Phil Blunsom
The Emergence of Reproducibility and Consistency in Diffusion Models
Huijie Zhang ⋅ Jinfan Zhou ⋅ Yifu Lu ⋅ Minzhe Guo ⋅ Liyue Shen ⋅ Qing Qu
Exploring Attribute Variations in Style-based GANs using Diffusion Models
Rishubh Parihar ⋅ Prasanna Balaji ⋅ Raghav Magazine ⋅ Sarthak Vora ⋅ Tejan Karmali ⋅ Varun Jampani ⋅ Venkatesh Babu R
LDM3D-VR: Latent Diffusion Model for 3D VR
Gabriela Ben-Melech Stan ⋅ Diana Wofk ⋅ Estelle Aflalo ⋅ Shao-Yen Tseng ⋅ zhipeng cai ⋅ Michael Paulitsch ⋅ VASUDEV LAL
DiffDock-Pocket: Diffusion for Pocket-Level Docking with Sidechain Flexibility
Michael Plainer ⋅ Marcella Toth ⋅ Simon Dobers ⋅ Hannes Stärk ⋅ Gabriele Corso ⋅ Céline Marquet ⋅ Regina Barzilay
Probing Intersectional Biases in Vision-Language Models with Counterfactual Examples
Phillip Howard ⋅ Avinash Madasu ⋅ Tiep Le ⋅ Gustavo Lujan-Moreno ⋅ VASUDEV LAL
WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models
Changhoon Kim ⋅ Kyle Min ⋅ Maitreya Patel ⋅ Sheng Cheng ⋅ 'YZ' Yezhou Yang
$f$-GANs Settle Scores!
Siddarth Asokan ⋅ Nishanth Shetty ⋅ Aadithya Srikanth ⋅ Chandra Seelamantula
Latent Painter
Shih-Chieh Su
LoRA can Replace Time and Class Embeddings in Diffusion Probabilistic Models
Joo Young Choi ⋅ Jaesung Park ⋅ Inkyu Park ⋅ Jaewoong Cho ⋅ Albert No ⋅ Ernest Ryu
Importance-Guided Diffusion
Paris Flood ⋅ Pietro Lió
Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Models
Gabriele Corso ⋅ Yilun Xu ⋅ Valentin De Bortoli ⋅ Regina Barzilay ⋅ Tommi Jaakkola
Adversarial Estimation of Topological Dimension with Harmonic Score Maps
Eric Yeats ⋅ Cameron Darwin ⋅ Frank Liu ⋅ Hai Li
Generative Fractional Diffusion Models
Gabriel Nobis ⋅ Marco Aversa ⋅ Maximilian Springenberg ⋅ Michael Detzel ⋅ Stefano Ermon ⋅ Shinichi Nakajima ⋅ Roderick Murray-Smith ⋅ Sebastian Lapuschkin ⋅ Christoph Knochenhauer ⋅ Luis Oala ⋅ Wojciech Samek
Text-Aware Diffusion Policies
Calvin Luo ⋅ Chen Sun
CommonCanvas: An Open Diffusion Model Trained with Creative-Commons Images
Aaron Gokaslan ⋅ A. Feder Cooper ⋅ Jasmine Collins ⋅ Landan Seguin ⋅ Austin Jacobson ⋅ Mihir Patel ⋅ Jonathan Frankle ⋅ Cory Stephenson ⋅ Volodymyr Kuleshov
Beyond Surface Statistics: Scene Representations in a Latent Diffusion Model
Yida Chen ⋅ Fernanda Viégas ⋅ Martin Wattenberg
DiffusionShield: A Watermark for Data Copyright Protection against Generative Diffusion Models
Yingqian Cui ⋅ Jie Ren ⋅ Han Xu ⋅ Pengfei He ⋅ Hui Liu ⋅ Lichao Sun ⋅ Yue XING ⋅ Jiliang Tang
Drag-guided diffusion models for vehicle image generation
Nikos Arechiga ⋅ Frank Permenter ⋅ Binyang Song ⋅ Chenyang Yuan
DFU: scale-robust diffusion model for zero-shot super-resolution image generation
Alexander Havrilla ⋅ Kevin Rojas ⋅ Wenjing Liao ⋅ Molei Tao
Diffusion Models without Attention
Nathan Yan ⋅ Jiatao Gu ⋅ Alexander Rush
Effective Data Augmentation With Diffusion Models
Brandon Trabucco ⋅ Kyle Doherty ⋅ Max Gurinas ⋅ Russ Salakhutdinov
DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting
Salva Rühling Cachay ⋅ Bo Zhao ⋅ Hailey Joren ⋅ Rose Yu
ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion Models
Maitreya Patel ⋅ Tejas Gokhale ⋅ Chitta Baral ⋅ 'YZ' Yezhou Yang
Functional Flow Matching
Gavin Kerrigan ⋅ Giosue Migliorini ⋅ Padhraic Smyth
Diffusion-Augmented Neural Processes
Lorenzo Bonito ⋅ James Requeima ⋅ Aliaksandra Shysheya ⋅ Richard Turner
Leveraging Diffusion Disentangled Representations to Mitigate Shortcuts in Underspecified Visual Tasks
Luca Scimeca ⋅ Alexander Rubinstein ⋅ Armand Nicolicioiu ⋅ Damien Teney ⋅ Yoshua Bengio
Score Normalization for a Faster Diffusion Exponential Integrator Sampler (DEIS)
Guoxuan Xia ⋅ Duolikun Danier ⋅ Ayan Das ⋅ Stathi Fotiadis ⋅ Farhang Nabiei ⋅ Ushnish Sengupta ⋅ Alberto Bernacchia
AlignDiff: Aligning Diverse Human Preferences via Behavior-Customisable Diffusion Model
Zibin Dong ⋅ Yifu Yuan ⋅ Jianye Hao ⋅ Fei Ni ⋅ Yao Mu ⋅ YAN ZHENG ⋅ Yujing Hu ⋅ Tangjie Lv ⋅ Changjie Fan ⋅ ZHIPENG HU
LC-SD: Realistic Endoscopic Image Generation with Stable Diffusion and ControlNet
Joanna Kaleta ⋅ Diego Dall'Alba ⋅ Szymon Plotka ⋅ Przemyslaw Korzeniowski
Masked Multi-time Diffusion for Multi-modal Generative Modeling
Mustapha BOUNOUA ⋅ Giulio Franzese ⋅ Pietro Michiardi
MOFDiff: Coarse-grained Diffusion for Metal-Organic Framework Design
Xiang Fu ⋅ Tian Xie ⋅ Andrew Rosen ⋅ Tommi Jaakkola ⋅ Jake Smith
Successfully Applying Lottery Ticket Hypothesis to Diffusion Model
Chao Jiang ⋅ Bo Hui ⋅ Bohan Liu ⋅ Da Yan
Strong generalization in diffusion models
Zahra Kadkhodaie ⋅ Florentin Guth ⋅ Eero Simoncelli ⋅ Stephane Mallat
Diffusion Models With Learned Adaptive Noise Processes
Subham Sahoo ⋅ Aaron Gokaslan ⋅ Christopher De Sa ⋅ Volodymyr Kuleshov
Diffusing More Objects for Semi-Supervised Domain Adaptation with Less Labeling
Leander van den Heuvel ⋅ Gertjan Burghouts ⋅ David Zhang ⋅ Gwenn Englebienne ⋅ Sabina van Rooij
Aligning Optimization Trajectories with Diffusion Models for Constrained Design Generation
Giorgio Giannone ⋅ Akash Srivastava ⋅ Ole Winther ⋅ Faez Ahmed
TADA: Timestep-Aware Data Augmentation for Diffusion Models
NaHyeon Park ⋅ Kunhee Kim ⋅ Song Park ⋅ Jung-Woo Ha ⋅ Hyunjung Shim
Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints
Jian Chen ⋅ Ruiyi Zhang ⋅ Yufan Zhou ⋅ Rajiv Jain ⋅ Zhiqiang Xu ⋅ Ryan Rossi ⋅ Changyou Chen
Manifold Diffusion Fields
Ahmed Elhag ⋅ Yuyang Wang ⋅ Joshua Susskind ⋅ Miguel Angel Bautista