Zexiang Xu (徐泽祥)

VP of R&D at Hillbot Inc.

zexiangxu AT gmail.com

[CV] [Google Scholar] [Twitter]


I am Vice President of Research and Development at Hillbot, where I mainly work on multimodal foundation models for robotics and embodied AI. Prior to joining Hillbot, I was a research scientist at Adobe Research, working on neural 3D, 3D large models, and GenAI foundation models. Before that, I obtained my Ph.D. at University of California, San Diego, advised by Prof. Ravi Ramamoorthi.

My research lies at the intersection of computer vision, computer graphics, machine learning, and AI foundation models. My previous work has broadly covered 3D reconstruction, 3D generation, neural representations, view synthesis, relighting, appearance modeling, and appearance acquisition.

News

  • NEW! [Dec, 2024] I left Adobe and joined Hillbot as VP of Research and Development.
  • NEW! [Sep, 2024] I will serve as an Area Chair for CVPR 2025.
  • NEW! [Sep, 2024] Three papers are accepted to NeurIPS 2024.
  • NEW! [July, 2024] Two papers are accepted to ECCV 2024.
  • NEW! [Mar, 2024] I'm co-organizing the 1st workshop on 3D foundation models (3dfm.github.io) at CVPR 2024.
  • NEW! [Feb, 2024] I gave talks at UIUC, University of Tübingen, and Oregon State University on 3D AI GenTech.
  • NEW! [Feb, 2024] One paper is accepted to CVPR 2024 as a highlight presentation!
  • NEW! [Jan, 2024] Four papers are accepted to ICLR 2024 and three of them are selected as spotlight presentations!
  • [Nov, 2023] I finally opened my twitter account. Let's connect @zexiangxu !
  • [Sep, 2023] Two papers are accepted to NeurIPS 2023.
  • [Aug, 2023] One paper gets conditionally accepted to SIGGRAPH Asia 2023.
  • [July, 2023] One paper gets accepted to ICCV 2023.
  • [Mar, 2023] Two papers are accepted to SIGGRAPH 2023.
  • [Feb, 2023] Two papers are accepted to CVPR 2023.
  • [Dec, 2022] I will serve as an Area Chair for ICCV 2023.
  • [Aug, 2022] One paper gets accepted to Siggraph Asia 2022.
  • [July, 2022] Three papers get accepted to ECCV 2022; TensoRF gets 3 strong accepts in the final review.
  • [Mar, 2022] One paper gets accepted to SIGGRAPH 2022.
  • [Mar, 2022] Four papers (two oral presentations) get accepted to CVPR 2022!
  • [July 30, 2021] One paper gets accepted to SIGGRAPH Asia 2021.
  • [Jun 18, 2021] One paper gets accepted to TOG 2022.
  • [July 22, 2021] MVSNeRF gets accepted to ICCV 2021.
  • [Jun 8, 2021] One paper gets accepted to EGSR 2021.
  • [May 21, 2021] I am a recipient of the 2021 Chancellor's Dissertation Medal of UCSD!
  • [Mar 26, 2021] Two papers get accepted to SIGGRAPH 2021.
  • [Mar 1, 2021] Two papers (both oral) get accepted to CVPR 2021.
  • [July 31, 2020] One paper gets accepted to SIGGRAPH Asia 2020.
  • [July 6, 2020] I joined Adobe Research as a research scientist.
  • [July 2, 2020] Two papers (one spotlight) get accepted to ECCV 2020.
  • [May 27, 2020] One paper gets accepted to EGSR 2020 (CGF track).
  • [Feb 2, 2020] Two papers (one oral) get accepted to CVPR 2020.
  • [Jul 29, 2019] One paper gets accepted to SIGGRAPH Asia 2019.
  • [Mar 25, 2019] Two papers get accepted to SIGGRAPH 2019.
  • [Nov 11, 2018] I'm honored to receive the 2019 Adobe Research Fellowship .
  • [Aug 11, 2018] One paper gets accepted to SIGGRAPH Asia 2018.
  • [Mar 26, 2018] One paper gets accepted to SIGGRAPH 2018.
  • [Feb 27, 2017] One paper gets accepted to CVPR 2017.
  • [Jul 23, 2016] One paper gets accepted to SIGGRAPH Asia 2016.
  • [Sep 27, 2015] I started as a Ph.D. student at UC San Diego.
  • [Aug 14, 2014] One paper gets accepted to SIGGRAPH Asia 2014.

Service

  • Area Chair: ICCV 2023, CVPR 2025
  • Paper Committee: Eurographics 2024; EGSR 2022-2024
  • Conference Reviewer: CVPR, ECCV, ICCV, ICLR, SIGGRAPH, SIGGRAPH Asia, Eurographics, Pacific Graphics,...
  • Journal Reviewer: TOG, TIP, TPAMI, CGF...
  • Workshop Organizer: 3D foundation models (CVPR 2024)

    • Selected Publications


    *,† denotes equal contribution or advisory.
    LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias
    Haian Jin, Hanwen Jiang, Hao Tan, Kai Zhang, Sai Bi, Tianyuan Zhang, Fujun Luan, Noah Snavely, Zexiang Xu
    arXiv 2024
    [Paper] [Project]
    Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats
    Ziwen Chen, Hao Tan, Kai Zhang, Sai Bi, Fujun Luan, Yicong Hong, Fuxin Li, Zexiang Xu
    arXiv 2024
    [Paper] [Project]
    MeshLRM: Large Reconstruction Model for High-Quality Meshes
    Xinyue Wei*, Kai Zhang*, Sai Bi, Hao Tan, Fujun Luan, Valentin Deschaintre, Kalyan Sunkavalli, Hao Su, Zexiang Xu
    arXiv 2024
    [Paper] [Project]
    Neural Gaffer: Relighting Any Object via Diffusion
    Haian Jin, Yuan Li, Fujun Luan, Yuanbo Xiangli, Sai Bi, Kai Zhang, Zexiang Xu, Jin Sun, Noah Snavely
    NeurIPS 2024
    [Paper] [Project]
    LRM-Zero: Training Large Reconstruction Models with Synthesized Data
    Desai Xie, Sai Bi, Zhixin Shu, Kai Zhang, Zexiang Xu, Yi Zhou, Sören Pirk, Arie Kaufman, Xin Sun, Hao Tan
    NeurIPS 2024
    [Paper] [Project]
    DMesh: A Differentiable Mesh Representation
    Sanghyun Son, Matheus Gadelha, Yang Zhou, Zexiang Xu, Ming C. Lin, Yi Zhou
    NeurIPS 2024
    [Paper] [Project]
    GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting
    Kai Zhang*, Sai Bi*, Hao Tan*, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, Zexiang Xu
    ECCV 2024
    [Paper] [Project]
    SuperGaussian: Repurposing Video Models for 3D Super Resolution
    Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Früshtück
    ECCV 2024
    [Paper] [Project]
    Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling
    Liwen Wu, Sai Bi, Zexiang Xu, Fujun Luan, Kai Zhang, Iliyan Georgiev, Kalyan Sunkavalli, Ravi Ramamoorthi
    CVPR 2024 (Highlight)
    [Paper] [Project]
    DMV3D:Denoising Multi-View Diffusion using 3D Large Reconstruction Model
    Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu†, Kai Zhang†
    ICLR 2024 (Spotlight)
    [Paper] [Project]
    PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Prediction
    Peng Wang, Hao Tan, Sai Bi, Yinghao Xu, Fujun Luan, Kalyan Sunkavalli, Wenping Wang, Zexiang Xu, Kai Zhang
    ICLR 2024 (Spotlight)
    [Paper] [Project]
    Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model
    Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, Sai Bi
    ICLR 2024
    [Paper] [Project]
    MovingParts: Motion-based Part Discovery in Dynamic Radiance Field
    Kaizhi Yang, Xiaoshuai Zhang, Zhiao Huang, Xuejin Chen, Zexiang Xu†, Hao Su†
    ICLR 2024 (Spotlight)
    [Paper] [Project]
    MCNeRF: Monte Carlo Rendering and Denoising for Real-Time NeRFs
    Kunal Gupta, Miloš Hašan, Zexiang Xu, Fujun Luan, Kalyan Sunkavalli, Xin Sun, Manmohan Chandraker, Sai Bi
    SIGGRAPH Asia 2023
    [Paper] [Project]
    Strivec: Sparse Tri-Vector Radiance Fields
    Quankai Gao*, Qiangeng Xu*, Hao Su, Ulrich Neumann, Zexiang Xu
    ICCV 2023
    [Paper] [Code]
    One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization
    Minghua Liu*, Chao Xu*, Haian Jin*, Linghao Chen*, Mukund Varma T, Zexiang Xu, Hao Su
    NeurIPS 2023
    [Project] [Code]
    Dictionary Fields: Learning a Neural Basis Decomposition
    Anpei Chen, Zexiang Xu, Xinyue Wei, Siyu Tang, Hao Su, Andreas Geiger
    SIGGRAPH 2023 (Journal Track)
    [Project]
    Factor Fields: A Unified Framework for Neural Fields and Beyond
    Anpei Chen, Zexiang Xu, Xinyue Wei, Siyu Tang, Hao Su, Andreas Geiger
    arXiv 2023
    [Project] [Paper]
    TensoIR: Tensorial Inverse Rendering
    Haian Jin*, Isabella Liu*, Peijia Xu, Xiaoshuai Zhang, Songfang Han, Sai Bi, Xiaowei Zhou, Zexiang Xu†, Hao Su†
    CVPR 2023
    [Project] [Paper]
    RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
    Titas Anciukevicius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J. Mitra, Paul Guerrero
    CVPR 2023
    [Project] [Paper]
    TensoRF: Tensorial Radiance fields
    Anpei Chen*, Zexiang Xu*, Andreas Geiger, Jingyi Yu , Hao Su
    ECCV 2022
    [Project] [Paper]
    ARF: Artistic Radiance Fields
    Kai Zhang, Nick Kolkin, Sai Bi, Fujun Luan, Zexiang Xu, Eli Shechtman, Noah Snavely
    ECCV 2022
    [Project] [Paper]
    Physically-based Editing of Indoor Scene Lighting from a Single Image
    Zhengqin Li, Jia Shi, Sai Bi, Rui Zhu, Kalyan Sunkavalli, Miloš Hašan, Zexiang Xu, Ravi Ramamoorthi, Manmohan Chandraker
    ECCV 2022 (Oral)
    [Project] [Paper]
    Rendering Neural Materials on Curved Surfaces
    Alexandr Kuznetsov, Xuezheng Wang, Krishna Mullia, Fujun Luan, Zexiang Xu, Miloš Hašan, Ravi Ramamoorthi
    SIGGRAPH 2022
    [Project]
    NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
    Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su, Zexiang Xu
    CVPR 2022 (Oral)
    [Project] [Paper]
    Point-NeRF: Point-based Neural Radiance Fields
    Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu Kalyan Sunkavalli , Ulrich Neumann
    CVPR 2022 (Oral)
    [Project] [Paper]
    RigNeRF: Fully Controllable Neural 3D Portraits
    ShahRukh Athar, Zexiang Xu, Kalyan Sunkavalli, Eli Shechtman, Zhixin Shu
    CVPR 2022
    [Paper]
    PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes
    Yu-Ying Yeh, Zhengqin Li, Yannick Hold-Geoffroy, Rui Zhu, Zexiang Xu, Miloš Hašan, Kalyan Sunkavalli, Manmohan Chandraker
    CVPR 2022
    [Paper]
    MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
    Anpei Chen*, Zexiang Xu*, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, Hao Su
    ICCV 2021
    [arXiv] [Project]
    NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting
    Tiancheng Sun*, Kai-En Lin*,Sai Bi, Zexiang Xu, Ravi Ramamoorthi
    EGSR 2021
    [Project]
    Path Graphs: Iterative Path Space Filtering
    Xi Deng, Miloš Hašan, Nathan Carr, Zexiang Xu, Steve Marschner
    SIGGRAPH Asia 2021 (TOG)
    [Paper]
    NeuMIP: Multi-Resolution Neural Materials
    Alexandr Kuznetsov, Krishna Mullia, Zexiang Xu, Miloš Hašan, Ravi Ramamoorthi
    SIGGRAPH 2021 (TOG)
    [Project]
    Hierarchical Neural Reconstruction for Path Guiding Using Hybrid Path and Photon Samples
    Shilin Zhu, Zexiang Xu,Tiancheng Sun, Alexandr Kuznetsov, Mark Meyer, Henrik Wann Jensen, Hao Su, Ravi Ramamoorthi
    SIGGRAPH 2021 (TOG)
    [Paper]
    Photon-Driven Neural Path Guiding
    Shilin Zhu, Zexiang Xu,Tiancheng Sun, Alexandr Kuznetsov, Mark Meyer, Henrik Wann Jensen, Hao Su, Ravi Ramamoorthi
    TOG 2022
    [arXiv]
    NeuTex: Neural Texture Mapping for Volumetric Neural Rendering
    Fanbo Xiang, Zexiang Xu,Miloš Hašan, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Hao Su
    CVPR 2021 (Oral)
    [arXiv] [Project]
    OpenRooms: An Open Framework for Photorealistic Indoor Scene Datasets
    Zhengqin Li, Ting-Wei Yu, Shen Sang, Sarah Wang, Meng Song, Yuhan Liu, Yu-Ying Yeh, Rui Zhu, Nitesh Gundavarapu, Jia Shi, Sai Bi, Zexiang Xu, Hong-Xing Yu, Kalyan Sunkavalli, Miloš Hašan, Ravi Ramamoorthi, Manmohan Chandraker
    CVPR 2021 (Oral)
    [Project]
    Light stage super-resolution: continuous high-frequency relighting
    Tiancheng Sun, Zexiang Xu, Xiuming Zhang, Sean Fanello, Christoph Rhemann, Paul Debevec, Yun-Ta Tsai, Jonathan T. Barron, Ravi Ramamoorthi
    SIGGRAPH Asia 2020 (TOG)
    [Project]
    Neural Reflectance Fields for Appearance Acquisition
    Sai Bi*, Zexiang Xu*, Pratul P. Srinivasan, Ben Mildenhall, Kalyan Sunkavalli, Miloš Hašan, Yannick Hold-Geoffroy, David Kriegman, Ravi Ramamoorthi
    arXiv 2020
    [arXiv]
    Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Images
    Sai Bi, Zexiang Xu, Kalyan Sunkavalli, Miloš Hašan, Yannick Hold-Geoffroy, David Kriegman, Ravi Ramamoorthi
    ECCV 2020 (Spotlight)
    [arXiv] [video]
    Deep Multi Depth Panoramas for View Synthesis
    Kai-En Lin, Zexiang Xu, Ben Mildenhall, Pratul P. Srinivasan, Yannick Hold-Geoffroy, Stephen DiVerdi, Qi Sun, Kalyan Sunkavalli, Ravi Ramamoorthi
    ECCV 2020
    [arXiv] [video]
    Deep Kernel Density Estimation for Photon Mapping
    Shilin Zhu*, Zexiang Xu*, Henrik Wann Jensen, Hao Su, Ravi Ramamoorthi
    EGSR 2020 (CGF journal track)
    [paper]
    Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awareness
    Shuo Cheng*, Zexiang Xu*, Shilin Zhu, Zhuwen Li, Li Erran Li, Ravi Ramamoorthi, Hao Su
    CVPR 2020 (Oral)
    [arXiv]
    Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images
    Sai Bi, Zexiang Xu, Kalyan Sunkavalli, David Kriegman, Ravi Ramamoorthi
    CVPR 2020
    [arXiv] [video]
    Learning Generative Models for Rendering Specular Microgeometry
    Alexandr Kuznetsov, Miloš Hašan,Zexiang Xu, Lingqi Yan, Bruce Walter, Nima Khademi Kalantari, Steve Marschner, Ravi Ramamoorthi
    SIGGRAPH Asia 2019 (TOG)
    [arXiv] [video]
    Deep View Synthesis from Sparse Photometric Images
    Zexiang Xu, Sai Bi, Kalyan Sunkavalli, Sunil Hadap, Hao Su, Ravi Ramamoorthi
    SIGGRAPH 2019 (TOG)
    [paper] [video]
    Single Image Portrait Relighting
    Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi
    SIGGRAPH 2019 (TOG)
    [paper] [video]
    Learning to Reconstruct Shape and Spatially-Varying Reflectance from a Single Image
    Zhengqin Li, Zexiang Xu, Ravi Ramamoorthi, Kalyan Sunkavalli, Manmohan Chandraker
    SIGGRAPH Asia 2018 (TOG)
    [paper] [video]
    Deep Image-based Relighting from Optimal Sparse Samples
    Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, Ravi Ramamoorthi
    SIGGRAPH 2018 (TOG)
    [paper] [project]
    Robust Energy Minimization for BRDF-Invariant Shape from Light Fields
    Zhengqin Li, Zexiang Xu, Ravi Ramamoorthi, Manmohan Chandraker
    CVPR 2017
    [paper]
    Minimal BRDF Sampling for Two-Shot Near-Field Reflectance Acquisition
    Zexiang Xu, Jannik Boll Nielsen, Jiyang Yu, Henrik Wann Jensen, Ravi Ramamoorthi
    SIGGRAPH Asia 2016
    [paper]
    Dynamic Hair Capture using Spacetime Optimization
    Zexiang Xu, Hsiang-Tao Wu, Lvdi Wang, Changxi Zheng, Xin Tong, Yue Qi
    SIGGRAPH Asia 2014
    [paper] [video]