M. Guo, J. Xu, Y. Zhang, J. Song, H. Peng, Y. Deng, X. Dong, K. Nakayama, Z. Geng, C. Wang, B. Ni, G. Yang, Y. Rao, H. Peng, H. Hu, G. Wetzstein, S. Hu

ICML 2025

Vision

ReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondences

L. Zhu, S. Cai, S. Huang, G. Wetzstein, N. Khosravan, I. Armeni

ACM SIGGRAPH 2025

Vision · Graphics · Diffusion Models

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

J. Shenoy, A. Levy, K. Ayyer, F. Poitevin, G. Wetzstein

Nature Communications 2025

Optics & imaging

Self-Calibrating Gaussian Splatting for Large Field-of-View Reconstruction

Y. Deng, W. Xian, G. Yang, L. Guibas, G. Wetzstein, S. Marschner, P. Debevec

ICCV 2025

Vision

Synthetic aperture waveguide holography for compact mixed-reality displays with large etendue

S. Choi, C. Jang, D. Lanman, G. Wetzstein

Nature Photonics 2025

Optics & imaging

Textured Gaussians for Enhanced 3D Scene Appearance Modeling

B. Chao, H. Tseng, L. Porzi, C. Gao, T. Li, Q. Li, A. Saraf, J. Huang, J. Kopf, G. Wetzstein, C. Kim

CVPR 2025

Vision

The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion

C. Chen, J. Zhang, S. Lakshmikanth, Y. Fang, R. Shao, G. Wetzstein, L. Fei-Fei, E. Adeli

CVPR 2025

World models · Vision

Video World Models with Long-term Spatial Memory

T. Wu, S. Yang, R. Po, Y. Xu, Z. Liu, D. Lin, G. Wetzstein

NeurIPS 2025

World models · Vision · Diffusion Models

Visual Chronicles: Using Multimodal LLMs to Analyze Massive Collections of Images

B. Deng, K. Genova, S. Peng, G. Wetzstein, N. Snavely, L. Guibas, T. Funkhouser

ICCV 2025

Vision

WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actions

Z. Li*, H. Yu*, W. Liu, Y. Yang, C. Herrmann, G. Wetzstein, J. Wu

ICCV 2025

World models · Vision · Physical AI · Diffusion Models

X-Dyna: Expressive Dynamic Human Image Animation

D. Chang, H. Xu, Y. Xie, Y. Gao, Z. Kuang, S. Cai, C. Zhang, G. Song, C. Wang, Y. Shi, Z. Chen, S. Zhou, L. Luo, G. Wetzstein, M. Soleymani

CVPR 2025 (Highlight)

World models · Diffusion Models

2024

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling

S. Bahmani, I. Skorokhodov, V. Rong, G. Wetzstein, L. Guibas, P. Wonka, S. Tulyakov, JJ Park, A. Tagliasacchi, D. Lindell

CVPR 2024

World models · Diffusion Models

Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control

Z. Kuang*, S. Cai*, H. He, Y. Xu, H. Li, L. Guibas, G. Wetzstein

NeurIPS 2024

World models · Diffusion Models

Compositional 3D Scene Generation using Locally Conditioned Diffusion

R. Po, G. Wetzstein

3DV 2024

World models · Diffusion Models

DehazeNeRF: Multiple Image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields

W. Chen, W. Yifan, S. Kuo, G. Wetzstein

3DV 2024

Optics & imaging · Vision

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

C. Nguyen, E. Chan, A. Bergman, G. Wetzstein

WACV 2024

Optics & imaging · Vision · Diffusion Models

DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model

Y. Xu, H. Tan, F. Luan, S. Bi, P. Wang, J. Li, Z. Shi, K. Sunkavalli, G. Wetzstein, Z. Xu, K. Zhang

ICLR 2024 (spotlight)

World models · Vision · Diffusion Models

Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos

C. Stearns, A. Harley, M. Uy, F. Dubost, F. Tombari, G. Wetzstein, L. Guibas

ACM SIGGRAPH Asia 2024

Vision · Graphics

Efficient 3D Articulated Human Generation with Layered Surface Volumes

Y. Xu, W. Yifan, A.W. Bergman, M. Chai, B. Zhou, G. Wetzstein

3DV 2024

World models

FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Models

Tong Wu, Yinghao Xu, Ryan Po, Mengchen Zhang, Guandao Yang, Jiaqi Wang, Ziwei Liu, Dahua Lin, Gordon Wetzstein

NeurIPS 2024 (Datasets and Benchmarks Track)

World models · Diffusion Models

Flow as the Cross-domain Manipulation Interface

M. Xu, Z. Xu, Y. Xu, C. Chi, G. Wetzstein, M. Veloso, S. Song

Conference on Robot Learning (CoRL) 2024

World models · Vision · Physical AI · Diffusion Models

Flying with Photons: Rendering Novel Views of Propagating Light

A. Malik, N. Juravsky, R. Po, G. Wetzstein, K. Kutulakos, D. Lindell

ECCV 2024

Optics & imaging · Vision

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

M. Gopakumar*, G.-Y. Lee*, S. Choi, B. Chao, Y. Peng, J. Kim, G. Wetzstein

Nature, 2024

Optics & imaging

Gaussian Shell Maps for Efficient 3D Human Generation

R. Abdal, W. Yifan, Z. Shi, Y. Xu, R. Po, Z. Kuang, Q. Chen, D. Yeung, G. Wetzstein

CVPR 2024

World models

GazeFusion: Saliency-guided Image Generation

Y. Zhang, N. Wu, C. Lin, G. Wetzstein, Q. Sun

ACM Transactions on Applied Perception (ACM Symposium on Applied Perception, journal track) 2024, Best Paper Award!

World models · Vision · Diffusion Models

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models

S. Cai, D. Ceylan, M. Gadelha, C. Huang, T. Wang, G. Wetzstein

CVPR 2024

World models · Diffusion Models

GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation

T. Wu, G. Yang, Z. Li, K. Zhang, Z. Liu, L. Guibas, D. Lin, G. Wetzstein

CVPR 2024

Vision

GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

Y. Xu*, Z. Shi*, W. Yifan, H. Chen, C. Yang, S. Peng, Y. Shen, G. Wetzstein

ECCV 2024

World models · Vision · Diffusion Models

Holographic parallax improves 3D perceptual realism

D. Kim, S. Nam, S. Choi, J. Seo, G. Wetzstein, Y. Jeong

ACM SIGGRAPH 2024

Optics & imaging · Graphics

HumanPlus: Humanoid Shadowing and Imitation from Humans

Z. Fu, Q. Zhao, Q. Wu, G. Wetzstein, C. Finn

Conference on Robot Learning (CoRL) 2024

Vision · Physical AI

Interpreting the Weight Space of Customized Diffusion Models

A. Dravid, Y. Gandelsman, K. Wang, R. Abdal, G. Wetzstein, A. Efros, K. Aberman

NeurIPS 2024

World models · Diffusion Models

Large Etendue 3D Holographic Display with Content-adaptive Dynamic Fourier Modulation

B. Chao, M. Gopakumar, S. Choi, J. Kim, L. Shi, G. Wetzstein

ACM SIGGRAPH Asia 2024

Optics & imaging · Graphics

LumiGAN: Unconditional Generation of Relightable 3D Human Faces

B. Deng, Y. Wang, G. Wetzstein

3DV 2024

World models

Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materials

Y. Fang*, Z. Sun*, T. Wu, J. Wang, Z. Liu, G. Wetzstein, D. Lin

NeurIPS 2024

Vision

MegaScenes: Scene-Level View Synthesis at Scale

J. Tung*, G. Chou*, R. Cai, G. Yang, K. Zhang, G. Wetzstein, B. Hariharan, N. Snavely

ECCV 2024

World models · Vision · Diffusion Models

MELON: NeRF with Unposed Images Using Equivalence Class Estimation

A. Levy, M. Matthews, M. Sela, G. Wetzstein, D. Lagun

3DV 2024

Vision

Mixture of neural fields for heterogeneous reconstruction in cryo-EM

Axel Levy, Rishwanth Raghu, David Shustin, Adele R Peng, Huan Li, Oliver B Clarke, Gordon Wetzstein, Ellen D Zhong

NeurIPS 2024

Optics & imaging

Neural Control Variates via Automatic Differentiation

Z. Li, G. Yang, Q. Zhao, X. Deng, L. Guibas, B. Hariharan, G. Wetzstein

ACM SIGGRAPH 2024

Graphics

Orthogonal Adaptation for Modular Customization of Diffusion Models

R. Po, G. Yang, K. Aberman, G. Wetzstein

CVPR 2024

World models · Diffusion Models

PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations

Y. Zheng*, Q. Zhao*, G. Yang, W. Yifan, D. Xiang, F. Dubost, D. Lagun, T. Beeler, F. Tombari, L. Guibas, G. Wetzstein

ECCV 2024

Vision · Physical AI · Graphics

PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors

H. So, L. Bose, P. Dudek, G. Wetzstein

CVPR 2024

Optics & imaging · Vision

Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior

Q. Zhao, P. Li, Y. Wang, O. Sorkine-Hornung, G. Wetzstein

Computer Graphics Forum (SCA) 2024

Vision · Graphics

Real-time 3D-aware Portrait Editing from a Single Image

Q. Bai, Z. Shi, Y. Xu, H. Ouyang, Q. Wang, C. Yang, X. Wang, G. Wetzstein, Y. Shen, Q. Chen

ECCV 2024

Vision

Robust Symmetry Detection via Riemannian Langevin Dynamics

Jihyeon Je, Jiayi Liu, Guandao Yang, Boyang Deng, Shengqu Cai, Gordon Wetzstein, Or Litany, Leonidas Guibas

ACM SIGGRAPH Asia 2024

Vision · Graphics

State of the Art on Diffusion Models for Visual Computing

R. Po, W. Yifan, V. Golyanik, K. Aberman, J. Barron, A. Bermano, E. Chan, T. Dekel, A. Holynski, A. Kanazawa, K. Liu, L. Liu, B. Mildenhall, M. Niessner, B. Ommer, C. Theobalt, P. Wonka, G. Wetzstein

Eurographics State-of-the-Art Report, 2024

World models · Graphics · Diffusion Models

Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion

B. Deng, R. Tucker, Z. Li, L. Guibas, N. Snavely, G. Wetzstein

ACM SIGGRAPH 2024

World models · Graphics · Diffusion Models

TC4D: Trajectory-Conditioned Text-to-4D Generation

S. Bahmani*, X. Liu*, Y. Wang*, I. Skorokhodov, V. Rong, Z. Liu, X. Liu, JJ Park, S. Tulyakov, G. Wetzstein, A. Tagliasacchi, D. B. Lindell

ECCV 2024

World models · Diffusion Models

2023

3D Neural Field Generation using Triplane Diffusion

R. Shue*, E. Chan*, Z. Ankner*, R. Po*, J. Wu, G. Wetzstein

CVPR 2023

World models · Diffusion Models

ALTO: Alternating Latent Topologies for Implicit 3D Reconstruction

Z. Wang, S. Zhou, J.J. Park, D. Paschalidou, S. You, G. Wetzstein, L. Guibas, A. Kadambi

CVPR 2023

Vision

Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models

A.W. Bergman, W. Yifan, G. Wetzstein

arxiv

World models · Diffusion Models

CC3D: Layout-Conditioned Generation of Compositional 3D Scenes

S. Bahmani, JJ Park, D. Paschalidou, X. Yan, G. Wetzstein, L. Guibas, A. Tagliasacchi

ICCV 2023

World models

DiffDreamer: Consistent Perpetual View Generation with Conditional Diffusion Models

S. Cai, E. Chan, S. Peng, M. Shahbazi, A. Obukhov, L. Van Gool, G. Wetzstein

ICCV 2023

World models · Diffusion Models

GeNVS: Generative Novel View Synthesis with 3D-Aware Diffusion Models

E. Chan*, K. Nagano*, M. Chan*, A. Bergman*, JJ Park*, A. Levy, M. Aittala, S. de Mello, T. Karras, G. Wetzstein

ICCV 2023

World models · Vision · Diffusion Models

High-brightness holographic projection

B. Chao, M. Gopakumar, S. Choi, G. Wetzstein

Optics Letters 2023

Optics & imaging

Instant Continual Learning of Neural Radiance Fields

R. Po, Z. Dong, A. Bergman, G. Wetzstein

ICCV Workshops 2023

World models · Vision

Learning Controllable Adaptive Simulation for Multi-resolution Physics

T. Wu*, T. Maruyama*, Q. Zhao*, G. Wetzstein, J. Leskovec

ICLR 2023

World models · Physical AI

Off-Axis Layered Displays: Hybrid Direct-View/Near-Eye Mixed Reality with Focus Cues

C. Ebner, P. Mohr, T. Langlotz, Y. Peng, D. Schmalstieg, G. Wetzstein, D. Kalkofen

IEEE TVCG (Proc. VR) 2023

Optics & imaging

PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields

Z. Kuang, F. Luan, S. Bi, Z. Shu, G. Wetzstein, K. Sunkavalli

CVPR 2023

Graphics

PointAvatar: Deformable Point-based Head Avatars from Videos

Y. Zheng, W. Yifan, G. Wetzstein, M. J. Black, O. Hilliges

CVPR 2023

Vision

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Pixel Tracking

Y. Zheng, A. Harley, B. Shen, G. Wetzstein, L. Guibas

ICCV 2023

Vision

Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization

C. Lin, K. Nagano, J. Kautz, E. Chan, U. Iqbal, L. Guibas, G. Wetzstein, S. Khamis

ACM SIGGRAPH 2023

Vision · Graphics

SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene

M. Son, J.J. Park, L. Guibas, G. Wetzstein

CVPR 2023

World models

Towards Attention-aware Foveated Rendering

B. Krajancich, P. Kellnhofer, G. Wetzstein

ACM SIGGRAPH 2023. Best Paper Honorable Mention Award!

Vision · Graphics

2022

3D GAN Inversion for Controllable Portrait Image Animation

C.Z. Lin*, D.B. Lindell*, E.R. Chan, G. Wetzstein

ECCV Workshop on Learning to Generate 3D Shapes and Scenes 2022

World models · Vision

3D-Aware Video Generation

S. Bahmani, JJ Park, D. Paschalidou, H. Tang, G. Wetzstein, L. Guibas, L. van Gool, R. Timofte

arXiv 2022

World models

Advances in Neural Rendering

A. Tewari et al.

Eurographics State-of-the-Art Report 2022

World models · Vision · Graphics

Amortized Inference for Heterogeneous Reconstruction in Cryo-EM

A. Levy, G. Wetzstein, J. Martel, F. Poitevin, E. Zhong

NeurIPS 2022

Optics & imaging

BACON: Band-limited Coordinate Networks for Multiscale Scene Representation

D. B. Lindell, D. Van Veen, J. J. Park, G. Wetzstein

CVPR 2022 (oral)

World models · Vision

CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images

A. Levy, F. Poitevin, J. Martel, Y. Nashed, A. Peck, N. Miolane, D. Ratner, M. Dunne, G. Wetzstein

ECCV 2022

Optics & imaging

Efficient Geometry-aware 3D Generative Adversarial Networks

E.R. Chan*, C.Z. Lin*, M.A. Chan*, K. Nagano*, B. Pan, S. De Mello, O. Gallo, L. Guibas, J. Tremblay, S. Khamis, T. Karras, G. Wetzstein

CVPR 2022 (oral)

World models

Generative Neural Articulated Radiance Fields

A.W. Bergman*, P. Kellnhofer*, W. Yifan*, E.R. Chan*, D.B. Lindell, G. Wetzstein

NeurIPS 2022

World models

Heterogeneous reconstruction of deformable atomic models in Cryo-EM

Y. Nashed, A. Peck, J. Martel, A. Levy, B. Koo, G. Wetzstein, N. Miolane, D. Ratner, F. Poitevin

NeurIPS 2022 Workshop on Machine Learning for Structural Biology (MLSB)

Optics & imaging

Holographic Glasses for Virtual Reality

J. Kim, M. Gopakumar, S. Choi, Y. Peng, W. Lopes, G. Wetzstein

SIGGRAPH 2022

Optics & imaging · Graphics

Larger visual changes compress time: The inverted effect of asemantic visual features on interval time perception

S. Malpica, B. Masia, L. Herman, G. Wetzstein, D. Eagleman, D. Gutierrez, Z. Bylinskii, Q. Sun

PLOS ONE 2022.

Vision

Learning Spatially Varying Pixel Exposures for Motion Deblurring

C. Nguyen, J. Martel, G. Wetzstein

ICCP 2022

Optics & imaging · Vision

Learning to Solve PDE-constrained Inverse Problems with Graph Networks

Q. Zhao, D. Lindell, G. Wetzstein

ICML 2022

World models · Physical AI

MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding

H. So, J. Martel, G. Wetzstein

ICCP 2022

Optics & imaging

NeuForm: Adaptive Overfitting for Neural Shape Editing

C. Lin, N. Mitra, L. Guibas, P. Guerrero

NeurIPS 2022

Graphics

ScanGAN360: A Generative Model of Realistic Scanpaths for 360° Images

D. Martin, A. Serrano, A. Bergman, G. Wetzstein, B. Masia

IEEE TVCG (Proc. VR) 2022. Best Paper Award!

Vision

Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators

S. Choi*, M. Gopakumar*, Y. Peng, J. Kim, G. Wetzstein

SIGGRAPH 2022

Optics & imaging · Graphics

Towards Retina-Quality VR Video Streaming: 15ms Could Save You 80% of Your Bandwidth

L. Hsiao, B. Krajancich, P. Levis, G. Wetzstein, K. Winstein

SIGCOMM Computer Communication Review (SIGCOMM CCR) 2022

Graphics

Video See-Through Mixed Reality with Focus Cues

C. Ebner, S. Mori, P. Mohr, Y. Peng, D. Schmalstieg, G. Wetzstein, D. Kalkofen

IEEE TVCG (Proc. VR) 2022. Best Paper Award!

Optics & imaging · Vision

2021

A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics

B. Krajancich, P. Kellnhofer, G. Wetzstein

ACM SIGGRAPH 2021

Graphics

ACORN: Adaptive Coordinate Networks for Neural Scene Representation

J. Martel, D. Lindell, C. Lin, E. Chan, M. Monteiro, G. Wetzstein

ACM SIGGRAPH 2021

World models · Vision · Graphics

AutoInt: Automatic Integration for Fast Neural Volume Rendering

D. Lindell, J. Martel, G. Wetzstein

CVPR 2021

Graphics

D-VDAMP: Denoising-based Approximate Message Passing for Compressive MRI

C. Metzler, G. Wetzstein

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021

Optics & imaging

Deep learning multi-shot 3D localization microscopy using hybrid optical-electronic computing

H. Ikoma, T. Kudo, Y. Peng, M. Broxton, G. Wetzstein

Optics Letters 2021

Optics & imaging

Deep S3PR: Simultaneous Source Separation and Phase Retrieval using Deep Generative Models

C. Metzler, G. Wetzstein

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021

Optics & imaging · Vision

Depth from Defocus with Learned Optics for Imaging and Occlusion-aware Depth Estimation

H. Ikoma, C. Nguyen, C. Metzler, Y. Peng, G. Wetzstein

IEEE ICCP 2021

Optics & imaging · Vision

Dirty Pixels: Optimizing Image Classification Architectures for Raw Sensor Data

S. Diamond*, V. Sitzmann*, F. Julca*, S. Boyd, G. Wetzstein, F. Heide

ACM Transactions on Graphics (presented at SIGGRAPH), 2021

Optics & imaging · Vision · Graphics

Event Based, Near Eye Gaze Tracking Beyond 10,000 Hz

A. Angelopoulos*, J.N.P. Martel*, A. Kohli, J. Conradt, G. Wetzstein

IEEE TVCG (Proc. VR), 2021

Optics & imaging · Vision

Fast Training of Neural Lumigraph Representations using Meta Learning

A. W. Bergman, P. Kellnhofer, G. Wetzstein

NeurIPS 2021

Vision

Holographic pancake optics for thin and lightweight optical see-through augmented reality

O. Cakmakci, Y. Qin, P. Bosel, G. Wetzstein

Optics Express 2021

Optics & imaging

Keyhole Imaging: Non-Line-of-Sight Imaging and Tracking of Moving Objects Along a Single Optical Path

C. Metzler, D. Lindell, G. Wetzstein

IEEE Transactions on Computational Imaging, 2021

Optics & imaging · Vision

Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays

S. Choi*, M. Gopakumar*, Y. Peng, J. Kim, G. Wetzstein

ACM Transactions on Graphics, ACM SIGGRAPH Asia 2021

Optics & imaging · Graphics

Neural Lumigraph Rendering

P. Kellnhofer, L. Jebe, A. Jones, R. Spicer, K. Pulli, G. Wetzstein

CVPR 2021 (oral)

Vision

Optimizing image quality for holographic near-eye displays with Michelson Holography

S. Choi, J. Kim, Y. Peng, G. Wetzstein

OSA Optica, 2021

Optics & imaging

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis

E. Chan*, M. Monteiro*, P. Kellnhofer, J. Wu, G. Wetzstein

CVPR 2021 (oral)

World models

Roadmap on digital holography

B. Javidi et al.

Optics Express (invited paper) 2021

Optics & imaging

Shift-variant color-coded diffractive spectral imaging system

H. Arguello, S. Pinilla, Y. Peng, H. Ikoma, J. Bacca, G. Wetzstein

Optica 2021

Optics & imaging

Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics

S. Baek, H. Ikoma, D. Jeon, Y. Li, W. Heidrich, G. Wetzstein, M. Kim

ICCV 2021

Optics & imaging · Vision

Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration

Y. Peng*, S. Choi*, J. Kim, G. Wetzstein

Science Advances 2021

Optics & imaging

SUREmap: Predicting Uncertainty in CNN-based Image Reconstructions using Stein's Unbiased Risk Estimate

R. Kitichotkul, C. Metzler, F. Ong, G. Wetzstein

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021

Optics & imaging · Vision

Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems

E. Vargas, J. Martel, G. Wetzstein, H. Arguello

ICCV 2021

Optics & imaging

Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays

S. M. Gopakumar, J. Kim, S. Choi, Y. Peng, G. Wetzstein

Optics Letters 2021

Optics & imaging

2020

Augmented and Virtual Reality

G. Wetzstein

Nano-Chips 2030 (book chapter), 2020

Optics & imaging

Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality

C. Richardt, J. Tompkin, G. Wetzstein

Real VR-Immersive Digital Reality (book chapter), 2020

Optics & imaging · Vision

Cortical Observation by Synchronous Multifocal Optical Sampling Reveals Widespread Population Encoding of Actions

I. Kauvar, T. Machado, E. Yuen, J. Kochalka, M. Choi, W. Allen, G. Wetzstein, K. Deisseroth

Neuron, 2020

Optics & imaging

Deep Adaptive LiDAR: End-to-end Optimization of Sampling and Depth Completion at Low Sampling Rates

A. Bergman, D. Lindell, G. Wetzstein

IEEE ICCP 2020

Optics & imaging · Vision · Physical AI

Deep Optics for Single-shot High-dynamic-range Imaging

C. Metzler, Hayato Ikoma, Y. Peng, G. Wetzstein

CVPR 2020 (oral)

Optics & imaging

Disambiguating Monocular Depth Estimation with a Single Transient

M. Nishimura, D.B. Lindell, C. Metzler, G. Wetzstein

ECCV 2020

Optics & imaging · Vision

Factored Occlusion: Single Spatial Light Modulator Occlusion-capable Optical See-through Augmented Reality Display

B. Krajancich*, N. Padmanaban*, G. Wetzstein

IEEE TVCG (Proc. VR), 2020

Optics & imaging

Gaze-contingent Ocular Parallax Rendering for Virtual Reality

R. Konrad, A. Agelopolous, G. Wetzstein

ACM Transactions on Graphics (presented at SIGGRAPH), 2020

Graphics

Implicit Neural Representations with Periodic Activation Functions

V. Sitzmann*, J. Martel*, A. Bergman, D. Lindell, G. Wetzstein

NeurIPS 2020 (oral, acceptance rate: 1%)

World models · Optics & imaging · Vision

Inference in artificial intelligence with deep optics and photonics

G. Wetzstein, A. Ozcan, S. Gigan, S. Fan, D. Englund, M. Soljacic, C. Denz, D.A.B. Miller, D. Psaltis

Nature (review paper), 2020

Optics & imaging · Vision

Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging

X. Dun, H. Ikoma, G. Wetzstein, Z. Wang, X. Cheng, Y. Peng

OSA Optica 2020

Optics & imaging

MetaSDF: Meta-Learning Signed Distance Functions

V. Sitzmann*, E. Chan*, R. Tucker, N. Snavely, G. Wetzstein

NeurIPS 2020

World models · Vision

Neural Holography with Camera-in-the-loop Training

Y. Peng, S. Choi, N. Padmanaban, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH Asia), 2020

Optics & imaging · Graphics

Neural Light Field 3D Printing

Q. Zheng, V. Babaei, G. Wetzstein, H.-P. Seidel, M. Zwicker, G. Singh

ACM Transactions on Graphics (SIGGRAPH Asia), 2020

Optics & imaging · Graphics

Neural Sensors: Optimizing Pixel Exposures for HDR Imaging and Video Compressive Sensing with Programmable Sensors

J. Martel, L. Muller, S. Carey, P. Dudek, G. Wetzstein

IEEE TPAMI (Proc. ICCP) 2020

Optics & imaging

Non-line-of-sight Imaging

D. Faccio, A. Velten, G. Wetzstein

Nature Reviews Physics (review paper), 2020

Optics & imaging · Vision

Non-line-of-sight Surface Reconstruction Using the Directional Light-cone Transform

S. Young, D. Lindell, B. Girod, D. Taubman, G. Wetzstein

CVPR 2020 (oral)

Optics & imaging · Vision

Optically sensing neural activity without imaging

G. Wetzstein, I. Kauvar

Nature Photonics, News & Views (commentary paper), 2020

Optics & imaging

Optimizing Depth Perception in Virtual and Augmented Reality through Gaze-contingent Stereo Rendering

B. Krajancich, P. Kellnhofer, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH Asia), 2020

Graphics

Roadmap on 3D integral imaging: sensing, processing, and display

B. Javidi et al.

Optics Express 2021

Optics & imaging · Vision

Semantic Implicit Neural Scene Representations with Semi-supervised Training

A. Kohli, V. Sitzmann, G. Wetzstein

International Conference on 3D Vision (3DV), 2020

World models · Vision

SPADnet: deep RGB-SPAD sensor fusion assisted by monocular depth estimation

Z. Sun, D. Lindell, O. Solgaard, G. Wetzstein

OSA Optics Express 2020

Optics & imaging · Vision

State of the Art in Perceptual VR Displays

G. Wetzstein, A. Patney, Q. Sun

Real VR-Immersive Digital Reality (book chapter), 2020

Optics & imaging

State of the Art on Neural Rendering

A. Tewari et al.

Eurographics State of the Art Report, 2020

World models · Vision · Graphics

Three-dimensional imaging through scattering media based on confocal diffuse tomography

D. Lindell, G. Wetzstein

Nature Communications, 2020

Optics & imaging

Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective

C. Chang, K. Bang, G. Wetzstein, B. Lee, L. Gao

Optica 2020

Optics & imaging

2019

A light-field metasurface for high-resolution single-particle tracking

A. Holsteen, D. Lin, I. Kauvar, G. Wetzstein, M.L. Brongersma

Nano Letters 2019

Optics & imaging

Acoustic Non-line-of-sight Imaging

D. Lindell, G. Wetzstein, V. Koltun

CVPR 2019 (oral)

Optics & imaging · Vision

Autofocals: Evaluating Gaze-Contingent Eyeglasses for Presbyopes

N. Padmanaban, R. Konrad, G. Wetzstein

Science Advances, 2019

Optics & imaging

Deep Optics for Monocular Depth Estimation and 3D Object Detection

J. Chang, G. Wetzstein

ICCV 2019

Optics & imaging · Vision · Physical AI

Deep Voxels: Learning Persistent 3D Feature Embeddings

V. Sitzmann, J. Thies, F. Heide, M. Niessner, G. Wetzstein, M. Zollhoefer

CVPR 2019 (oral)

World models · Vision

Holographic Near-Eye Displays Based on Overlap-Add Stereograms

N. Padmanaban, Y. Peng, G. Wetzstein

ACM SIGGRAPH Asia, 2019

Optics & imaging · Graphics

Learned Large Field-of-View Imaging With Thin-Plate Optics

Y. Peng, Q. Sun, X. Dun, G. Wetzstein, W. Heidrich, F. Heide

ACM SIGGRAPH Asia, 2019

Optics & imaging · Graphics

LiFF: Light Field Features in Scale and Depth

D. Dansereau, B. Girod, G. Wetzstein

CVPR 2019

Optics & imaging · Vision

Non-line-of-sight Imaging with Partial Occluders and Surface Normals

F. Heide, M. O'Toole, K. Zang, D. Lindell, S. Diamond, G. Wetzstein

ACM Transactions on Graphics (presented at SIGGRAPH), 2019

Optics & imaging · Vision · Graphics

Panoramic single-aperture multi-sensor light field camera

G. Schuster, D. Dansereau, G. Wetzstein, J. Ford

Optics Express, 2019

Optics & imaging

Scene Representation Networks: Continuous 3D-structure-aware Neural Scene Representations

V. Sitzmann, M. Zollhoefer, G. Wetzstein

NeurIPS 2019 (oral, acceptance rate: 0.5%; Outstanding New Directions Award!)

World models · Vision

Varifocal Occlusion-Capable Optical See-through Augmented Reality Display based on Focus-tunable Optics

K. Rathinavel, G. Wetzstein, H. Fuchs

IEEE TVCG (Proc. ISMAR), 2019

Optics & imaging

Wave-based Non-line-of-sight Imaging using Fast fk-Migration

D. Lindell, G. Wetzstein, M. O'Toole

ACM SIGGRAPH, 2019

Optics & imaging · Vision · Graphics

2018

A convex 3D deconvolution algorithm for low photon count fluorescence imaging

H. Ikoma, M. Broxton, T. Kudo, G. Wetzstein

Scientific Reports, 2018

Optics & imaging

Confocal Non-line-of-sight Imaging based on the Light-cone Transform

M. O'Toole, D. Lindell, G. Wetzstein

Nature, 2018

Optics & imaging · Vision

Convolutional Sparse Coding for RGB+NIR Imaging

X. Hu, F. Heide, Q. Dai, G. Wetzstein

IEEE Transactions on Image Processing 27 (4), 2018

Optics & imaging · Vision

Deep End-to-End Time-of-Flight Imaging

S. Su, F. Heide, G. Wetzstein, W. Heidrich

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Optics & imaging · Vision

Electron Ghost Imaging

S. Li, F. Cropp, K. Kabra, T.J. Lane, G. Wetzstein, P. Musumeci, D. Ratner

Physical review letters 121 (11), 2018

Optics & imaging

End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging

V. Sitzmann*, S. Diamond*, Y. Peng*, X. Dun, S. Boyd, W. Heidrich, F. Heide, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2018 (*joint first authorship)

Optics & imaging · Graphics

Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification

J. Chang, V. Sitzmann, X. Dun, W. Heidrich, G. Wetzstein

Scientific Reports, 2018

Optics & imaging · Vision

Saliency in VR: How do people explore virtual environments?

V. Sitzmann, A. Serrano, A. Pavel, M. Agrawala, D. Gutierrez, B. Masia, G. Wetzstein

IEEE Transactions on Visualization and Computer Graphics (IEEE Virtual Reality), 2018

Vision

Single-Photon 3D Imaging with Deep Sensor Fusion

D. Lindell, M. O'Toole, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2018

Optics & imaging · Vision · Graphics

Single-shot speckle correlation fluorescence microscopy in thick scattering tissue with image reconstruction priors

J. Chang, G. Wetzstein

Journal of biophotonics 11 (3), 2018

Optics & imaging

Sub-picosecond photon-efficient 3D imaging using single-photon sensors

F. Heide, S. Diamond, D. B. Lindell, G. Wetzstein

Scientific Reports, 2018

Optics & imaging

Time-multiplexed light field synthesis via factored Wigner distribution function

S. Hamann, L. Shi, O. Solgaard, G. Wetzstein

Optics letters 43 (3), 2018

Optics & imaging

Towards a Machine-learning Approach for Sickness Prediction in Virtual Environments

N. Padmanaban, T. Ruban, V. Sitzmann, A. Norcia, G. Wetzstein

IEEE Transactions on Visualization and Computer Graphics (IEEE Virtual Reality), 2018

Vision

Towards Transient Imaging at Interactive Rates with Single-photon Detectors

D. Lindell, M. O'Toole, G. Wetzstein

IEEE International Conference on Computational Photography (ICCP), 2018

Optics & imaging

2017

A Wide-Field-of-View Monocentric Light Field Camera

D. Dansereau, G. Schuster, J. Ford, G. Wetzstein

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

Optics & imaging

Accommodation-invariant Computational Near-eye Displays

R. Konrad, N. Padmanaban, K. Molner, E. Cooper, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2017

Optics & imaging · Graphics

Aperture interference and the volumetric resolution of light field fluorescence microscopy

I. Kauvar, J. Chang, G. Wetzstein

IEEE International Conference on Computational Photography (ICCP), 2017

Optics & imaging

Consensus Convolutional Sparse Coding

B. Choudhury, R. Swanson, F. Heide, G. Wetzstein, W. Heidrich

International Conference on Computer Vision (ICCV), 2017

Optics & imaging · Vision

Evaluation of Accommodation Response to Monovision for Virtual Reality

N. Padmanaban, R. Konrad, G. Wetzstein

OSA Imaging and Applied Optics Congress, 2017

Optics & imaging

Gaze-contingent Adaptive Focus Near-eye Displays

N. Padmanaban, R. Konrad, E. Cooper, G. Wetzstein

Invited paper at SID Display Week, 2017

Optics & imaging · Vision

Movie Editing and Cognitive Event Segmentation in Narrative Virtual Reality

A. Serrano, V. Sitzmann, J. Ruiz-Borau, G. Wetzstein, D. Gutierrez, B. Masia

ACM Transactions on Graphics (SIGGRAPH), 2017

Graphics

Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays

N. Padmanaban, R. Konrad, T. Stramer, E. Cooper, G. Wetzstein

Proceedings of the National Academy of Sciences (PNAS), February 2017

Optics & imaging · Vision

Panoramic Monocentric Light Field Camera

G. Schuster, I. Agurok, J. Ford, D. Dansereau, G. Wetzstein

OSA Optical Design and Fabrication Congress (IODC), 2017

Optics & imaging

Reconstructing Transient Images from Single-Photon Sensors

M. O'Toole, F. Heide, D. Lindell, S. Diamond, K. Zang, G. Wetzstein

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

Optics & imaging

Snapshot difference imaging using correlation time-of-flight sensors

C Callenberg, F Heide, G Wetzstein, M Hullin

ACM Transactions on Graphics (SIGGRAPH Asia) 36 (6) , 2017

Optics & imaging · Graphics

SpinVR: Towards Live-Streaming 3D Virtual Reality Video

Robert Konrad, Donald G Dansereau, Aniq Masood, Gordon Wetzstein

ACM Transactions on Graphics (SIGGRAPH Asia), 2017

Optics & imaging · Vision · Graphics

2016

3D Displays

Martin S Banks, David M Hoffman, Joohwan Kim, Gordon Wetzstein

Annual Review of Vision Science 2 (1)

Optics & imaging

Application of light field displays to vision correction and accommodation support

F.C. Huang, R. Konrad, G. Wetzstein

SPIE Stereoscopic Displays and Applications (Electronic Imaging), 2016

Optics & imaging

Computational Imaging with Multi-camera Time-of-Flight Systems

S. Shreshtha, F. Heide, W. Heidrich, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2016

Optics & imaging · Vision · Graphics

Convolutional Sparse Coding for High Dynamic Range Imaging

A. Serrano, F. Heide, D. Gutierrez, G. Wetzstein, B. Masia

Computer Graphics Forum (Eurographics), 2016. Best Paper Honorable Mention!

Optics & imaging · Vision · Graphics

Depth Augmented Stereo Panorama for Cinematic Virtual Reality with Focus Cues

Jayant Thatte, Jean-Baptiste Boin, Haricharan Lakshman, Gordon Wetzstein, Bernd Girod

IEEE International Conference on Image Processing (ICIP). Conference Best Paper for Industry Award!

Optics & imaging · Vision

Light Field, Focus-tunable, and Monovision Near-eye Displays

G. Wetzstein

SID Symposium Digest of Technical Papers 47 (1), 358-360

Optics & imaging

Novel Optical Configurations for Virtual Reality: Evaluating User Preference and Performance with Focus-tunable and Monovision Near-eye Displays

R. Konrad, E. Cooper, G. Wetzstein

ACM SIGCHI, 2016

Optics & imaging

Photonic Multitasking Interleaved Si Nanoantenna Phased Array

Dianmin Lin, Aaron L Holsteen, Elhanan Maguid, Gordon Wetzstein, Pieter G Kik, Erez Hasman, Mark L Brongersma

Nano Letters 16 (12)

Optics & imaging

ProxImaL: Efficient Image Optimization using Proximal Algorithms

F. Heide, S. Diamond, M. Niessner, J. Ragan-Kelly, W. Heidrich, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2016

Optics & imaging · Vision · Graphics

Tensor low-rank and sparse light field photography

Mahdad Hosseini Kamal, Barmak Heshmat, Ramesh Raskar, Pierre Vandergheynst, Gordon Wetzstein

Computer Vision and Image Understanding 145, 172-181

Optics & imaging · Vision

Variable Aperture Light Field Photography: Overcoming the Diffraction-limited Spatio-angular Resolution Tradeoff

J. Chang, I. Kauvar, X. Hu, G. Wetzstein

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Optics & imaging

2015

Adaptive Color Display via Perceptually-driven Factored Spectral Projection

I. Kauvar, S. Yang, L. Shi, I. McDowall, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH Asia), 2015

Optics & imaging · Graphics

Doppler Time-of-Flight Imaging

F. Heide, W. Heidrich, M. Hullin, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2015

Optics & imaging · Vision · Graphics

Extended Field-of-View and Increased-Signal 3D Holographic Illumination with Time-division Multiplexing

S. Yang, W. Allen, I. Kauvar, A. Andalman, N. Young, C. Kim, J. Marshel, G. Wetzstein, K. Deisseroth

Optics Express, 2015

Optics & imaging

Fast and Flexible Convolutional Sparse Coding

F. Heide, W. Heidrich, G. Wetzstein

IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral), 2015

Optics & imaging · Vision

On the Duality of Compressive Light Field Imaging and Display

G. Wetzstein

Invited paper at SID Display Week, 2015

Optics & imaging

The Light Field Stereoscope: Immersive Computer Graphics via Factored Near-Eye Light Field Display with Focus Cues

F.C. Huang, K. Chen, G. Wetzstein

ACM Transactions on Graphics (SIGGRAPH), 2015

Optics & imaging · Graphics

Why People Should Care About Light Field Displays

Gordon Wetzstein

Invited paper at SID Information Display, Vol. 31, No. 2, 2015

Optics & imaging

Wide Field of View Compressive Light Field Display using a Multilayer Architecture and Tracked Viewers

R. Chen, A. Maimone, H. Fuchs, R. Raskar, G. Wetzstein

Journal of the Society for Information Display, 2015

Optics & imaging

Advancing physical and spatial AI.

Recent projects

Policy-based Foveated Imaging and Perception

Video World Models with Long-term Spatial Memory

CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models

Gaussian Wave Splatting

AIpparel: A Multimodal Foundation Model for Digital Garments

Holographic AR Glasses with Metasurface Waveguides

Publications

2026

Asymmetric Flow Models↗

BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Models↗

BulletTime: Decoupled Control of Time and Camera Pose for Video Generation↗

Captain Cinema: Towards Short Movie Generation↗

Dual Ascent Diffusion for Inverse Problems↗

Garment Particles: A 2D-3D Symmetric Garment Representation for Generation and Editing↗

GaussFusion: Improving 3D Reconstruction in the Wild with Geometry-Informed Video Generator↗

Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control↗

Infinite Gaze Generation for Videos with Autoregressive Diffusion↗

Masked Visual Actions for Unified World Modeling↗

MeshFlow: Mesh Generation with Equivariant Flow Matching↗

Mixture of Contexts for Long Video Generation↗

Mode Seeking meets Mean Seeking for Fast Long Video Generation↗

Modeling Atomic Conformational Ensembles of Proteins via Test-Time Supervision of Boltz-2 on Cryo-EM Density Maps↗

MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines↗

Neural phase microscopy with metasurface optics for real-time and nanoscale quantitative phase imaging↗

pi-Flow: Policy-Based Few-Step Generation via Imitation Distillation↗

Policy-based Foveated Imaging and Perception↗

ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization↗

Spectral Progressive Diffusion for Efficient Image and Video Generation↗

SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training↗

StreetNVS: Effective Multi-sensor Conditioning for Street-view Novel-view Synthesis↗

TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learning↗

VULCAN: Tool-Augmented Multi Agents for Iterative 3D Object Arrangement↗

World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video↗

2025

3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting↗

AIpparel: A Multimodal Foundation Model for Digital Garments↗

Buffer Anytime: Zero-Shot Video Depth and Normal from Single-View Priors↗

CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models↗

CameraCtrl: Enabling Camera Control for Video Diffusion Models↗

CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization↗

CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models↗

CryoDRGN-AI: neural ab initio reconstruction of challenging cryo-EM and cryo-ET datasets↗

Diffusion Self-Distillation for Zero-Shot Customized Image Generation↗

FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views↗

Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Models↗

Gaussian Mixture Flow Matching Models↗

Gaussian Wave Splatting for Computer-Generated Holography↗

GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photography↗

Geometric Algebra Planes: Convex Implicit Neural Volumes↗

GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling↗

ImageGem: In-the-wild Generative Image Interaction Dataset for Generative Model Personalization↗

Interspatial Attention for Efficient 4D Human Video Generation↗

LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation↗

Long-Context State-Space Video World Models↗

Multiscale guidance of AlphaFold3 with heterogeneous cryo-EM data↗

R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation↗

ReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondences↗

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning↗

Self-Calibrating Gaussian Splatting for Large Field-of-View Reconstruction↗

Synthetic aperture waveguide holography for compact mixed-reality displays with large etendue↗

Textured Gaussians for Enhanced 3D Scene Appearance Modeling↗

The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion↗

Video World Models with Long-term Spatial Memory↗

Visual Chronicles: Using Multimodal LLMs to Analyze Massive Collections of Images↗

WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actions↗

X-Dyna: Expressive Dynamic Human Image Animation↗

2024

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling↗

Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control↗

Compositional 3D Scene Generation using Locally Conditioned Diffusion↗

DehazeNeRF: Multiple Image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields↗

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition↗

DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model↗

Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos↗

Efficient 3D Articulated Human Generation with Layered Surface Volumes↗

FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Models↗

Flow as the Cross-domain Manipulation Interface↗

Flying with Photons: Rendering Novel Views of Propagating Light↗

Asymmetric Flow Models

BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Models

BulletTime: Decoupled Control of Time and Camera Pose for Video Generation

Captain Cinema: Towards Short Movie Generation

Dual Ascent Diffusion for Inverse Problems

Garment Particles: A 2D-3D Symmetric Garment Representation for Generation and Editing

GaussFusion: Improving 3D Reconstruction in the Wild with Geometry-Informed Video Generator

Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control

Infinite Gaze Generation for Videos with Autoregressive Diffusion

Masked Visual Actions for Unified World Modeling

MeshFlow: Mesh Generation with Equivariant Flow Matching

Mixture of Contexts for Long Video Generation

Mode Seeking meets Mean Seeking for Fast Long Video Generation

Modeling Atomic Conformational Ensembles of Proteins via Test-Time Supervision of Boltz-2 on Cryo-EM Density Maps

MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines

Neural phase microscopy with metasurface optics for real-time and nanoscale quantitative phase imaging

pi-Flow: Policy-Based Few-Step Generation via Imitation Distillation

Policy-based Foveated Imaging and Perception

ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization

Spectral Progressive Diffusion for Efficient Image and Video Generation

SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training

StreetNVS: Effective Multi-sensor Conditioning for Street-view Novel-view Synthesis

TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learning

VULCAN: Tool-Augmented Multi Agents for Iterative 3D Object Arrangement

World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video

3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting

AIpparel: A Multimodal Foundation Model for Digital Garments

Buffer Anytime: Zero-Shot Video Depth and Normal from Single-View Priors

CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models

CameraCtrl: Enabling Camera Control for Video Diffusion Models

CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization

CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models

CryoDRGN-AI: neural ab initio reconstruction of challenging cryo-EM and cryo-ET datasets

Diffusion Self-Distillation for Zero-Shot Customized Image Generation

FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views

Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Models

Gaussian Mixture Flow Matching Models

Gaussian Wave Splatting for Computer-Generated Holography

GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photography

Geometric Algebra Planes: Convex Implicit Neural Volumes

GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling

ImageGem: In-the-wild Generative Image Interaction Dataset for Generative Model Personalization

Interspatial Attention for Efficient 4D Human Video Generation

LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation

Long-Context State-Space Video World Models

Multiscale guidance of AlphaFold3 with heterogeneous cryo-EM data

R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation

ReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondences

Scalable 3D reconstruction for X-ray single particle imaging with online machine learning

Self-Calibrating Gaussian Splatting for Large Field-of-View Reconstruction

Synthetic aperture waveguide holography for compact mixed-reality displays with large etendue

Textured Gaussians for Enhanced 3D Scene Appearance Modeling

The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion

Video World Models with Long-term Spatial Memory

Visual Chronicles: Using Multimodal LLMs to Analyze Massive Collections of Images

WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actions

X-Dyna: Expressive Dynamic Human Image Animation

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling

Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control

Compositional 3D Scene Generation using Locally Conditioned Diffusion

DehazeNeRF: Multiple Image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model

Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos

Efficient 3D Articulated Human Generation with Layered Surface Volumes

FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Models

Flow as the Cross-domain Manipulation Interface

Flying with Photons: Rendering Novel Views of Propagating Light

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

Gaussian Shell Maps for Efficient 3D Human Generation

GazeFusion: Saliency-guided Image Generation

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models

GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation

GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

Holographic parallax improves 3D perceptual realism

HumanPlus: Humanoid Shadowing and Imitation from Humans

Interpreting the Weight Space of Customized Diffusion Models

Large Etendue 3D Holographic Display with Content-adaptive Dynamic Fourier Modulation

LumiGAN: Unconditional Generation of Relightable 3D Human Faces

Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materials