Zhihang Zhong is a researcher at Shanghai AI Laboratory.
In 2023, he received his Ph.D. degree in Computer Science from the University of Tokyo (UTokyo).
In 2020, he received his M.E. degree in Precision Engineering from the UTokyo.
In 2018, he received his B.E. degree in Mechatronics from Chu Kochen Honors College, Zhejiang University.
Zhihang's current research interests include:
* Neural Rendering (NeRF/3DGS)
* AI for Sports
* Low-level Vision
We are looking for
(1) highly self-motivated Joint Ph.D. students (上海交大, 复旦, 浙大, 中科大等联合培养博士);
(2) interns with strong background and publications;
(3) remote collaborators with relevant and interesting ideas (we can provide sufficient A100s and 4090s, as well as specialized equipment for 3D data acquisition).
If you are interested, please email me with your CV and your published papers.
News
[see more]
[2024.08] Our SportsStrat (浦动) empowers the 2024 Paris Olympics!
[2024.07] Glad to receive the 2023 Chinese Government Award for Outstanding
Self-financed Students Abroad (Group B, Global Top 50)!
[2024.07] Three papers (one Oral) are accepted to ECCV 2024!
[2024.05] We release SportsStrat (浦动) on CCTV5 in support of the 2024 Thomas & Uber Cups!
[2024.03] Glad to receive the Dean's Award for Academic Achievement from the UTokyo!
[2024.02] Two papers are accepted to CVPR 2024.
[2023.12] I give a talk at OpenMMLab about temporal super-resolution. [2023.11] Glad to release InterpAny-Clearer project!
[2023.07] Two papers are accepted to ICCV 2023.
[2023.07] One paper is accepted to ACM-MM 2023.
[2023.03] I am accepted to CVPR 2023's Doctoral Consortium.
[2023.02] Two papers are accepted to CVPR 2023.
[2022.10] I give a talk at MIPI Workshop 2022.
[2022.10] One paper is accepted to IJCV.
[2022.09] I become a JSPS「日本学術振興会」DC fellow!
[2022.07] Three papers (one Oral) are accepted to ECCV 2022!
[2022.04] I become a JEM intern at Microsoft.
[2022.03] One paper is accepted to CVPR 2022.
[2021.09] I become a research intern in the Visual Computing group at MSRA.
[2021.04] I become a IIW fellow「知能社会創造フェローシップ生」of UTokyo!
[2021.04] One paper is accepted to IoTJ.
[2021.02] One paper is accepted to CVPR 2021.
[2020.11] I become a MSRA D-CORE fellow!
[2020.09] I obtain my M.E. degree from UTokyo with an outstanding thesis award!
[2020.07] One paper (Spotlight) is accepted to ECCV 2020!
[2019.12] One paper is accepted to IUI 2020.
Publications
| GAST: Sequential Gaussian Avatars with Hierarchical Spatio-temporal Context Wangze Xu, Yifan Zhan, Zhihang Zhong†, Xiao Sun† arXiv, 2024 arXiv |
| Bundle Adjusted Gaussian Avatars Deblurring Muyao Niu, Yifan Zhan, Qingtian Zhu, Zhuoxiao Li, Wei Wang, Zhihang Zhong†, Xiao Sun†, Yinqiang Zheng arXiv, 2024 arXiv / code |
| ToMiE: Towards Modular Growth in Enhanced SMPL Skeleton for 3D Human with Animatable Garments Yifan Zhan, Qingtian Zhu, Muyao Niu, Mingze Ma, Jiancheng Zhao, Zhihang Zhong†, Xiao Sun†, Yu Qiao, Yinqiang Zheng arXiv, 2024 arXiv / code |
| X as Supervision: Contending with Depth Ambiguity in Unsupervised Monocular 3D Pose Estimation Yuchen Yang, Xuanyi Liu, Xing Gao, Zhihang Zhong, Xiao Sun arXiv, 2024 arXiv |
| DIR: Retrieval-Augmented Image Captioning with Comprehensive Understanding Hao Wu, Zhihang Zhong†, Xiao Sun† arXiv, 2024 arXiv |
| Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence Yutong Chen, Yifan Zhan, Zhihang Zhong†, Wei Wang, Xiao Sun†, Yu Qiao, Yinqiang Zheng ECCV, 2024 project page / arXiv / code |
| Clearer Frames, Anytime: Resolving Velocity Ambiguity in Video Frame Interpolation Zhihang Zhong*, Xiao Sun, Yu Qiao, Gurunandan Krishnan, Sizhuo Ma, Jian Wang ECCV, 2024, Oral project page / arXiv / code / demo |
| KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter Yifan Zhan, Zhuoxiao Li, Muyao Niu, Zhihang Zhong, Shohei Nobuhara, Ko Nishino, Yinqiang Zheng ECCV, 2024 |
| IQ-VFI: Implicit Quadratic Motion Estimation for Video Frame Interpolation Mengshun Hu, Kui Jiang, Zhihang Zhong, Zheng Wang, Yinqiang Zheng CVPR, 2024 paper |
| Fooling Polarization-based Vision using Locally Controllable Polarizing Projection Zhuoxiao Li, Zhihang Zhong, Shohei Nobuhara, Ko Nishino, Yinqiang Zheng CVPR, 2024 paper / arXiv |
| DiffBody: Human Body Restoration by Imagining with Generative Diffusion Prior Yiming Zhang, Zhe Wang, Xinjie Li, Yunchen Yuan, Chengsong Zhang, Xiao Sun, Zhihang Zhong†, Jian Wang† arXiv, 2024 arXiv |
| NIR-assisted Low-light Video Enhancement Using Unpaired 24-hour Data Muyao Niu, Zhihang Zhong, Yinqiang Zheng ICCV, 2023 paper / code |
| Rethinking Video Frame Interpolation from Shutter Mode Induced Degradation Xiang Ji, Zhixiang Wang, Zhihang Zhong, Yinqiang Zheng ICCV, 2023 paper |
| ClipCrop: Conditioned Cropping Driven by Vision-Language Model Zhihang Zhong*, Mingxi Cheng, Zhirong Wu, Yuhui Yuan, Yinqiang Zheng, Ji Li, Han Hu, Stephen Lin, Yoichi Sato, Imari Sato ICCV Workshops, 2023 arXiv |
| Event-guided Frame Interpolation and Dynamic Range Expansion of Single Rolling Shutter Image Guixu Lin, Jin Han, Mingdeng Cao, Zhihang Zhong, Yinqiang Zheng ACM-MM, 2023 paper |
| Blur Interpolation Transformer for Real-World Motion from Blur Zhihang Zhong*, Mingdeng Cao, Xiang Ji, Yinqiang Zheng, Imari Sato CVPR, 2023 project page / paper / arXiv / code / zhihu |
| Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Dark Muyao Niu, Zhuoxiao Li, Zhihang Zhong, Yinqiang Zheng CVPR, 2023 paper / arXiv / code |
| Animation from Blur: Multi-modal Blur Decomposition with Motion Guidance Zhihang Zhong*, Xiao Sun, Zhirong Wu, Yinqiang Zheng, Stephen Lin, Imari Sato ECCV, 2022 project page / paper / arXiv / code / zhihu |
| Bringing Rolling Shutter Images Alive with Dual Reversed Distortion Zhihang Zhong*, Mingdeng Cao, Xiao Sun, Zhirong Wu, Zhongyi Zhou, Yinqiang Zheng, Stephen Lin, Imari Sato ECCV, 2022, Oral project page / paper / arXiv / code |
| Efficient Video Deblurring Guided by Motion Magnitude Yusheng Wang, Yunfan Lu, Ye Gao, Lin Wang, Zhihang Zhong, Yinqiang Zheng, Atsushi Yamashita ECCV, 2022 paper / arXiv / code |
| Towards real-world video deblurring by exploring blur formation process Mingdeng Cao, Zhihang Zhong, Yanbo Fan, Jiahao Wang, Yong Zhang, Jue Wang, Yujiu Yang, Yinqiang Zheng ECCV Workshops, 2022 paper / arXiv / code |
| Learning Adaptive Warping for Real-World Rolling Shutter Correction Mingdeng Cao, Zhihang Zhong, Jiahao Wang, Yinqiang Zheng, Yujiu Yang CVPR, 2022 paper / arXiv / code |
| Real-world Video Deblurring: A Benchmark Dataset and An Efficient Recurrent Neural Network Zhihang Zhong*, Ye Gao, Yinqiang Zheng, Bo Zheng, Imari Sato International Journal of Computer Vision (IJCV), 2022 paper / arXiv / code |
| Towards Rolling Shutter Correction and Deblurring in Dynamic Scenes Zhihang Zhong*, Yinqiang Zheng, Imari Sato CVPR, 2021 paper / arXiv / code |
| Efficient Spatio-Temporal Recurrent Neural Network for Video Deblurring Zhihang Zhong*, Ye Gao, Yinqiang Zheng, Bo Zheng ECCV, 2020, Spotlight paper / arXiv / code |
| Multistream Temporal Convolutional Network for Correct/Incorrect Patient Transfer Action Detection Using Body Sensor Network Zhihang Zhong*, Chingszu Lin, Masako Kanai-Pak, Jukai Maeda, Yasuko Kitajima, Mitsuhiro Nakamura, Noriaki Kuwahara, Taiki Ogata, Jun Ota IEEE Internet of Things Journal (IoTJ), 2021 paper / code |
| Development and validation of robot patient equipped with an inertial measurement unit and angular position sensors to evaluate transfer skills of nurses Chingszu Lin, Taiki Ogata, Zhihang Zhong, Masako Kanai-Pak, Jukai Maeda, Yasuko Kitajima, Mitsuhiro Nakamura, Noriaki Kuwahara, Jun Ota International Journal of Social Robotics (IJSR), 2021 paper |
| Multi-attention deep recurrent neural network for nursing action evaluation using wearable sensor Zhihang Zhong*, Chingszu Lin, Taiki Ogata, Jun Ota IUI, 2020 paper |