🤗 About Me

I am currently a joint PhD student at the Computer Graphics Lab of ETH Zürich and DisneyResearch|Studios, supervised by Prof. Markus Gross and Dr. Christopher Schroers. I also spent 4 months working on low-level vision at the Computer Vision Lab, ETH Zürich. Before that, I received my M.E. and B.E. degrees respectively in 2023 and 2020 from the Electronic Information School of Wuhan University, where I work closely with Prof. Lei Yu on event-based vision. I am a lifelong learner with broad interests, including computer vision, signal processing, and neuromorphic computing. I am particularly interested in achieving robust perception in complex environments for real-world applications.

🔥 News

📝 Publications

ICCV 2023

Generalizing Event-Based Motion Deblurring in Real-World Scenarios

Xiang Zhang, Lei Yu^†, Wen Yang, Jianzhuang Liu, Gui-Song Xia

[Code] [Dataset] [Youtube]

• A scale-aware network is designed to allow flexible setups of input spatial resolutions and enable learning from different temporal scales of motion blur.
• A self-supervised learning framework is proposed for model training with real-world data and performance generalization in spatial and temporal domains.
• A multi-scale real-world blurry dataset (MS-RBD) is constructed to facilitate the evaluation of deblurring performance in real-world scenarios.

TPAMI 2022

Learning to See Through with Events

Lei Yu^†, Xiang Zhang, Wei Liao, Wen Yang, Gui-Song Xia

[Code] [Dataset] [Bilibili]

• An event-based synthetic aperture imaging (E-SAI) algorithm is proposed to see through dense occlusions even under extreme lighting conditions.
• A hybrid network composed of an spiking encoder and a convolutional decoder is designed to mitigate the disturbances from occlusions and guarantee the overall reconstruction performance.

CVPR 2022

Unifying Motion Deblurring and Frame Interpolation with Events

Xiang Zhang, Lei Yu^†

[Code] [Youtube]

• We present a unified framework for event-based video deblurring and interpolation (EVDI).
• By utilizing the constraints between cross-modal frames and events, a fully self-supervised learning method is proposed to enable network training with real-world data without requiring ground-truth images.

• TIP 2024 Neuromorphic Synergy for Video Binarization, Shijie Lin, Xiang Zhang, Lei Yang, Lei Yu, Bin Zhou, Xiaowei Luo, Wenping Wang, Jia Pan. | [Code&Dataset] [Youtube] [Bilibili]

• TPAMI 2023 Learning to Super-Resolve Blurry Images with Events, Lei Yu^†, Bishan Wang, Xiang Zhang, Haijian Zhang, Wen Yang, Jianzhuang Liu, Gui-Song Xia. | [Code]

• TSP 2022 Spiking Sparse Recovery with Non-convex Penalties, Xiang Zhang, Lei Yu^†, Gang Zheng, Yonina C. Eldar.

• CVPR 2022 Synthetic Aperture Imaging with Events and Frames, Wei Liao^*, Xiang Zhang^*, Lei Yu^†, Shijie Lin, Wen Yang, Ning Qiao. | [Code] [Dataset]

• CVPR 2021 Event-based Synthetic Aperture Imaging with a Hybrid Network, Xiang Zhang^*, Wei Liao^*, Lei Yu^†, Wen Yang, Gui-Song Xia. (Oral, Best Paper Candidate) | [Code] [Dataset] [Youtube]

^* means equal contribution and ^† indicates my supervisor.

💬 Invited Talks

• 2021 & 2022, Introduction to Spiking Neural Networks, Wuhan University
• 2021, Event-based Synthetic Aperture Imaging with a Hybrid Network, VALSE Webinar | [Bilibili]
• 2021, Event-based Synthetic Aperture Imaging with a Hybrid Network, CSIG-3DV Student Forum

💻 Services

• Conference Review: CVPR, ICCV, ECCV
• Journal Review: Springer IJCV, Springer MIR

🍹 Misc

• 🎸 I love rock and hip-hop music. Mayday, Jay Chou, and Pharaoh are my favoriate.
• 📖 I enjoy reading all kinds of books. Echo’s story inspired me about love and traveling. My recent favoriate is the sci-fi novel The Three Body Problem written by Cixin Liu.
• 🎮 I often relax by playing games, including roguelike games like Slay the Spire and card games like Hearthstone. I recently played It Takes Two with my girlfriend, and it was super fun!
• 🛫 It always excites me when experiencing new cultures in new places. Here are some photos I took during my trips.