Research Scientist Intelligent Creation Lab ByteDance 682-246-1040 chenxuzhang@bytedance.com [CV]     [Google Scholar]     [Github]

Biography

I am a Research Scientist at the Intelligent Creation Lab, ByteDance. I completed my Ph.D. in Computer Science from the University of Texas at Dallas in 2023, under the supervision of Prof. Xiaohu Guo. Prior to that, I earned my Bachelor's degree in Software Engineering in 2015 and Master's degree in Computer Science in 2018, both from Beihang University in Beijing.

My research interests include Computer Graphics, Computer Vision, and AI, with a focus on Talking Face Generation, Conversational Gestures Synthesis, Deblur-NeRF with Human Motion, Text/Image to 3D, and Emotional Talking Avatar.

Feel free to drop me an email if we share common research interests.

Working Experience

• Bytedance, CA

  Research Scientist (May 2023 – Present)

• The University of Texas at Dallas

  Research Assistant (Jan. 2020 – May 2023)

• Bytedance, CA

  Research Intern (May 2022 – Aug. 2022)

• Bytedance, CA

  Research Intern (May 2021 – Aug. 2021)

Research

DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation. Preprint'24.




Sora Generates Videos with Stunning Geometrical Consistency. Xuanyi Li, Daquan Zhou, Chenxu Zhang, Shaodong Wei, Qibin Hou, Ming-Ming Cheng. Preprint'24. [paper]   [project page]   [code]




Magicanimate: Temporally consistent human image animation using diffusion model. Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, Mike Zheng Shou. Computer Vision and Pattern Recognition (CVPR), 2024. [paper]   [project page]   [code]




DR2: Disentangled Recurrent Representation Learning for Data-efficient Speech Video Synthesis. Chenxu Zhang, Chao Wang, Yifan Zhao, Shuo Cheng, Linjie Luo, Xiaohu Guo. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024. [paper]   [supplement]   [video]




Magic-Boost: Boost 3D Generation with Mutli-View Conditioned Diffusion. Fan Yang, Jianfeng Zhang, Yichun Shi, Bowen Chen, Chenxu Zhang, Huichao Zhang, Xiaofeng Yang, Jiashi Feng, Guosheng Lin. Preprint'24. [paper]   [project page]   [code]




AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text. Jianfeng Zhang, Xuanmeng Zhang, Huichao Zhang, Jun Hao Liew, Chenxu Zhang, Yi Yang, Jiashi Feng. Preprint'23. [paper]   [project page]   [code]




FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning. Chenxu Zhang, Yifan Zhao, Yifei Huang, Ming Zeng, Saifeng Ni, Madhukar Budagavi, Xiaohu Guo. International Conference on Computer Vision (ICCV), 2021. [paper]   [video]   [code]




3D Talking Face with Personalized Pose Dynamics. Chenxu Zhang, Saifeng Ni, Zhipeng Fan, Hongbo Li, Ming Zeng, Madhukar Budagavi, Xiaohu Guo. IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021. [paper]   [video]




DeSmoothGAN: Recovering Details of Smoothed Images via Spatial Feature-wise Transformation and Full Attention. Yifei Huang, Chenhui Li, Xiaohu Guo, Jing Liao, Chenxu Zhang, Changbo Wang. Proceedings of the 28th ACM International Conference on Multimedia (MM), 2020. [paper]   [supplement]




Modeling Yarn-level Geometry from a Single Micro-image. Hongyu Wu, Xiaowu Chen, Chenxu Zhang, Bin Zhou, Qinping Zhao. Frontiers of Information Technology Electronic Engineering, 2019. [paper]




Modeling Garment Seam from a Single Image. Chenxu Zhang, Xiaowu Chen, Hongyu Wu, Bin Zhou. Journal of Computer Science and Technology (JCST), 2018. [paper]

Activities

• Reviewer for Journal: TPAMI, TIP, TMM, etc.
• Reviewer for Conference: CVPR, ICCV, ECCV, AAAI, MM, PG, WACV, etc.