I am a PhD student at Sun Yat-sen University, advised by Prof. Xiaodan Liang at Human Cyber Physical Intelligence Integration Lab (HCP-I2 Lab). I am currently a visting PhD student in the Robotics Institute at Carnegie Mellon University, advised by Prof. Fernando de la Torre. I was a research intern at ByteDance and Tencent during my PhD study. Before starting my PhD, I received my BS and MS degrees from Sun Yat-sen University, advised by Prof. Jianhuang Lai and Prof. Xiaohua Xie.
My research interests lie in human-centric 2D/3D modeling and 3D generative model. Currently, I am focusing on high-fidelty 3D human avatar modeling and single-image-to-3D generation.
Recent Activities
- [07/2024] One paper (First author) about image-based 3D virtual try-on is accepted by ACM MM 2024.
- [01/2024] One paper about text-to-motion synthesis is accepted by TVCG 2024.
- [12/2023] One paper (First author) about text-to-motion synthesis is accepted by AAAI 2024.
- [12/2023] Glad to serve as a visiting scholar in the Robotics Institute at CMU.
- [03/2023] One paper (First author) about general purpose garment-to-person virtual try-on is accepted by CVPR 2023.
- [09/2022] One paper about hard pose person-to-person virtual try-on is accepted by NeurIPS 2022.
- [06/2022] One paper about cross-modal fashion image synthesis is accepted by ACM MM 2022.
- [03/2022] One paper about in-the-wild person-to-person virtual try-on is accepted by CVPR 2022.
- [10/2021] One paper (First author) about unpaired person-to-person virtual try-on is accepted by NeurIPS 2021.
- [10/2021] One paper (Co-first author) about dance video synthesis is accepted by TIP 2021.
- [08/2021] One paper about image-based 3D virtual try-on is accepted by ICCV 2021.
- [07/2021] One paper (First author) about Neural Architecture Search for garment-to-person virtual try-on is accepted by ACM MM 2021.
Publications and preprints
DreamVTON: Customizing 3D Virtual Try-on with Personalized Diffusion Models
Zhenyu Xie, Haoye Dong, Yufei Gao, Zehua Ma, Xiaodan Liang
ACM MM, 2024
arXiv / code / bibtex
Zhenyu Xie, Haoye Dong, Yufei Gao, Zehua Ma, Xiaodan Liang
ACM MM, 2024
arXiv / code / bibtex
GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generation
Xuehao Gao, Yang Yang, Zhenyu Xie, Shaoyi Du, Zhongqian Sun, Yang Wu
TVCG, 2024
arXiv / code / bibtex
Xuehao Gao, Yang Yang, Zhenyu Xie, Shaoyi Du, Zhongqian Sun, Yang Wu
TVCG, 2024
arXiv / code / bibtex
Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model
Zhenyu Xie, Yang Wu, Xuehao Gao, Zhongqian Sun, Wei Yang, Xiaodan Liang
AAAI, 2024
arXiv / code / bibtex
Zhenyu Xie, Yang Wu, Xuehao Gao, Zhongqian Sun, Wei Yang, Xiaodan Liang
AAAI, 2024
arXiv / code / bibtex
GP-VTON: Towards General Purpose Virtual Try-On via Collaborative Local-Flow Global-Parsing Learning
Zhenyu Xie, Zaiyu Huang, Xin Dong, Fuwei Zhao, Haoye Dong, Xijin Zhang, Feida Zhu, Xiaodan
CVPR, 2023
arXiv / code / bibtex
Zhenyu Xie, Zaiyu Huang, Xin Dong, Fuwei Zhao, Haoye Dong, Xijin Zhang, Feida Zhu, Xiaodan
CVPR, 2023
arXiv / code / bibtex
Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learning
Zaiyu Huang, Hanhui Li, Zhenyu Xie, Michael Kampffmeyer, qingling Cai, Xiaodan Liang
NeurIPS, 2022
arXiv / code / bibtex
Zaiyu Huang, Hanhui Li, Zhenyu Xie, Michael Kampffmeyer, qingling Cai, Xiaodan Liang
NeurIPS, 2022
arXiv / code / bibtex
Armani: Part-level garment-text alignment for unified cross-modal fashion design
Xujie Zhang, Yu Sha, Michael C. Kampffmeyer, Zhenyu Xie, Zequn Jie, Chengwen Huang, Jianqing Peng, Xiaodan Liang
ACM MM, 2022
arXiv / bibtex
Xujie Zhang, Yu Sha, Michael C. Kampffmeyer, Zhenyu Xie, Zequn Jie, Chengwen Huang, Jianqing Peng, Xiaodan Liang
ACM MM, 2022
arXiv / bibtex
Dressing in the Wild by Watching Dance Videos
Xin Dong, Fuwei Zhao, Zhenyu Xie, Xijin Zhang, Daniel K. Du, Min Zheng, Xiang Long, Xiaodan Liang, Jianchao Yang
CVPR, 2022
arXiv / project / bibtex
Xin Dong, Fuwei Zhao, Zhenyu Xie, Xijin Zhang, Daniel K. Du, Min Zheng, Xiang Long, Xiaodan Liang, Jianchao Yang
CVPR, 2022
arXiv / project / bibtex
Towards scalable unpaired virtual try-on via patch-routed spatially-adaptive gan
Zhenyu Xie, Zaiyu Huang, Fuwei Zhao, Haoye Dong, Michael Kampffmeyer, Xiaodan Liang
NeurIPS, 2021
arXiv / code / bibtex
Zhenyu Xie, Zaiyu Huang, Fuwei Zhao, Haoye Dong, Michael Kampffmeyer, Xiaodan Liang
NeurIPS, 2021
arXiv / code / bibtex
Image comes dancing with collaborative parsing-flow video synthesis
Bowen Wu*, Zhenyu Xie*, Xiaodan Liang, Yubei Xiao, Haoye Dong, Liang Lin
TIP, 2021
arXiv / bibtex
Bowen Wu*, Zhenyu Xie*, Xiaodan Liang, Yubei Xiao, Haoye Dong, Liang Lin
TIP, 2021
arXiv / bibtex
Was-vton: Warping architecture search for virtual try-on network
Zhenyu Xie, Xujie Zhang, Fuwei Zhao, Haoye Dong, Michael C Kampffmeyer, Haonan Yan, Xiaodan Liang
ACM MM, 2021
arXiv / bibtex
Zhenyu Xie, Xujie Zhang, Fuwei Zhao, Haoye Dong, Michael C Kampffmeyer, Haonan Yan, Xiaodan Liang
ACM MM, 2021
arXiv / bibtex
M3d-vton: A monocular-to-3d virtual try-on network
Fuwei Zhao, Zhenyu Xie, Michael Kampffmeyer, Haoye Dong, Songfang Han, Tianxiang Zheng, Tao Zhang, Xiaodan Liang
ICCV, 2021
arXiv / code / bibtex
Fuwei Zhao, Zhenyu Xie, Michael Kampffmeyer, Haoye Dong, Songfang Han, Tianxiang Zheng, Tao Zhang, Xiaodan Liang
ICCV, 2021
arXiv / code / bibtex
Fashion editing with adversarial parsing learning
Haoye Dong, Xiaodan Liang, Yixuan Zhang, Xujie Zhang, Xiaohui Shen, Zhenyu Xie, Bowen Wu, Jian Yin
CVPR, 2020
arXiv / bibtex
Haoye Dong, Xiaodan Liang, Yixuan Zhang, Xujie Zhang, Xiaohui Shen, Zhenyu Xie, Bowen Wu, Jian Yin
CVPR, 2020
arXiv / bibtex
Academic Services
Organizer for Workshop- CVPR 2020 Workshop on Human-centric Image/Video Synthesis L.I.P
- International Journal of Computer Vision (IJCV)
- Neural Networks
- IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- International Conference on Computer Vision (ICCV)
- European Conference on Computer Vision ECCV (ECCV)
- Annual Conference on Neural Information Processing Systems (NeurIPS)