Hi 👋, I am a 2nd-year PhD student at Monash University, supervised by Asst. Prof. Bohan Zhuang and Prof. Jianfei Cai. I am a member of Zhuang AI Group. My research focuses on model compression and efficiency.
News
- [2021.12.01] Our paper LIT got accepted by AAAI 2022.
- [2021.07.23] Our paper HVT and ORIST got accepted by ICCV 2021.
Education
- Ph.D in Computer Science, Monash University, 2021 - Now.
- M.S. in Computer Science, The University of Adelaide, 2020.
- B.E. in Software Engineering, Harbin Institute of Technology, Weihai, 2019.
Preprints
- Pruning Self-attentions into Convolutional Layers in Single Path
- Haoyu He, Jing Liu, Zizheng Pan, Jianfei Cai, Jing Zhang, Dacheng Tao, Bohan Zhuang
- [Code], [Paper]
- Mesa: A Memory-saving Training Framework for Transformers
- Zizheng Pan, Peng Chen, Haoyu He, Jing Liu, Jianfei Cai, Bohan Zhuang
- [Code], [Paper]
Publications
- Less is More: Pay Less Attention in Vision Transformers
- Zizheng Pan, Bohan Zhuang, Haoyu He, Jing Liu, Jianfei Cai
- AAAI Conference on Artificial Intelligence (AAAI), 2022
- [Code], [Paper]
- Scalable Visual Transformers with Hierarchical Pooling
- Zizheng Pan, Bohan Zhuang, Jing Liu, Haoyu He, Jianfei Cai
- International Conference on Computer Vision (ICCV), 2021
- [Code], [Paper]
- The Road to Know-Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation
- Yuankai Qi, Zizheng Pan, Yicong Hong, Ming-Hsuan Yang, Anton van den Hengel, Qi Wu
- International Conference on Computer Vision (ICCV), 2021
- [Code], [Paper]
- Object-and-Action Aware Model for Visual Language Navigation
- Yuankai Qi, Zizheng Pan, Shengping Zhang, Anton van den Hengel, Qi Wu
- European Conference on Computer Vision (ECCV), 2020
- [Paper]
Awards
- Adelaide Summer Research Scholarship, 2019
- Outstanding Graduate in Harbin Institute of Technology, 2019