SSP = Strong + Smart + Professional
- CSIG Member
About Me
I'm currently Vision Algorithm Researcher in StepFun (opens new window), working with Binxing Jiao (opens new window) and Yanan Wei. Before that I was served as R&D Engineer in Momenta (opens new window), working on perception group of MSD (Momenta Self-Driving).
I got my Master's degree and Bachelor's degree in the School of Informatics at Xiamen University. Especially, I spent wonderful time from 2019 to 2023 in the Visual Computing and Graphics Lab (opens new window), supervised by associate professor Ming Zeng (opens new window). In 2022.6 -2022.9, I served as a virutal human research intern at Virtual Human Group (opens new window) of NetEase Fuxi AI Lab (opens new window), working with Zhimeng Zhang (opens new window) and Yu Ding (opens new window).
My research interests lie at Computer Vision and Multi-modality LLM. I'm particularly interested in the areas of human-centric perception (pose estimation, restruction), generation and animation (speech audio or natural language driven).
News
- [Oct. 2023] Our work on 3D Human Reconstruction has been accepted by Graphical Models.
- [Sep. 2023] Our two National Invention Patents from China have been officially granted.
- [Nov. 2022] Our work on singing head generation has been accepted by CVM2023 and CVMJ.
- [Nov. 2022] Our work on talking head generation has been accepted by AAAI2023.
- [Oct. 2022] I and my roommate Yinglin Zheng (opens new window) won the National Scholarship for Graduate Students at the same time.
- [Aug. 2022] Our work on talking head generation has been submitted to AAAI2023.
- [Apr. 2022] Our work on multi-person pose estimation has been accepted by IJCAI2022.
- [Mar. 2021] Our work on maksed face revealing is accepted by ICME 2021 as oral presentation.
- [Feb. 2021] My zhihu survey on human pose (opens new window) is re-tweeted by several well-known AI WeChat accounts.
- [Oct. 2020] Our work on human pose estimation is accepted by PRCV 2020.
Some of my paper co-authors
Ming Zeng (opens new window), Associate Professor at School of Informatics, Xiamen University
Yinglin Zheng (opens new window), Research Intern at Visual Computing Group, Microsoft Research Asia (MSRA)
Jinpeng Lin (opens new window), Researcher at AlibabaGroup
Publications
Vertex position estimation with spatial–temporal transformer for 3D human reconstruction
Xiangjun Zhang, Yinglin Zheng, Wenjin Deng, Qifeng Dai, Yuxin Lin, Wangzheng Shi, Ming Zeng
2023, Graphical Models
MusicFace: Music-driven Expressive Singing Face Synthesis
Pengfei Liu, Wenjin Deng, Hengda Li, Jintai Wang, Yinglin Zheng, Yiwei Ding, Xiaohu Guo, Ming Zeng
2022, The Computational Visual Media Conference (CVM2023)
DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Video
Zhimeng Zhang*, Zhipeng Hu*, Wenjin Deng*, Changjie Fan, Tangjie Lv, Yu Ding*
2022, Thirty-Seventh AAAI Conference on Artificial Intelligence. (AAAI2023)
I^2R-Net: Intra- and Inter-Human Relation Network for Multi-Person Pose Estimation
Yiwei Ding*, Wenjin Deng*, Yinglin Zheng, Pengfei Liu, Jianmin Bao, Meihong Wang, Xuan Cheng, Ming Zeng, Dong Chen
2022, The 31st International Joint Conference on Artificial Intelligence (IJCAI2022)
Controllable Facial Caricaturization with Localized Deformation and Personalized Semantic Attentions
Ming Zeng, Yinglin Zheng, Jinpeng Lin, Xuan Cheng, Jing Liao, Zizhao Wu, Wenjin Deng
2021, IEEE Transactions on Multimedia (TMM2021).
Real-time Masked Face Revealing for Video Conference
Jinpeng Lin, Pengfei Liu, Yinglin Zheng, Wenjin Deng, Ming Zeng
2021, IEEE International Conference on Multimedia and Expo (ICME2021), Oral presentation.
VH3D-LSFM:Video-based Human 3D Pose Estimation with Long-term and Short-term Pose Fusion Mechanism
Wenjin Deng, Yinglin Zheng, Hui Li, Xianwei Wang, Zizhao Wu, Ming Zeng
2020, Chinese Conference on Pattern Recognition and Computer Vision (PRCV2020)
Patents and Copyrights
- [中国国家发明专利] CN202111117800.8 一种感知环境的语音驱动虚拟人姿态合成方法 （已授权）
曾鸣;邓文晋;丁艺伟;刘鹏飞
- [中国国家发明专利] CN202011092625.7 一种利用长短期信息融合的视频三维人体姿态估计算法 （已授权）
曾鸣;邓文晋
- [中国国家发明专利] CN202110750794.3 一种利用语音信息的实时视频人脸区域时空一致合成方法 （已授权）
曾鸣;刘鹏飞;邓文晋
- [中国国家发明专利] CN202011408727.5 一种增强医患相互信任减少医患矛盾评估预警系统 （已授权）
赵一麟;曾鸣;邓文晋;刘秋松;张红建;潘恒;丁艺伟;周旭;郭鹏;周媛媛;刘凤武
- [软件著作权] 2019SR0447844 智能交互健身系统 （已授权）
曾鸣,周熙盟,黄译嶙,陈梓豪,邓文晋
Projects
A management system for case workflow
Java Backend: Wenjin Deng, Pengfei Liu (opens new window)
H5 frontend: Yiwei Ding (opens new window), Wenjin Deng
2021
Watermeter Reader Autonomous System for paper Image-Based Automatic Watermeter Reading under Challenging Environments
Java Backend: Wenjin Deng, Jian Wang
H5 frontend: Yiwei Ding (opens new window)
2020
AI fitness coach in web(PC/Mobile) using our Human Pose Estimation Network. Benefit from our design, it infers well pose on user's local device with 25fps.
Human Pose Estimation Algorithm & Website: Zihao Chen (opens new window), Wenjin Deng
Team: Ximeng Zhou, Zihao Chen (opens new window), Wenjin Deng, Yilin Huang
2018.08-2019.5
A course system in web(PC/Mobile) using Springboot and VUE.
Java Backend: Shiqi Wang (opens new window), Wenjin Deng
H5 frontend: Tianyu Su, Zihao Chen (opens new window)
2018.11-2019.1
Awards & Honors
- National Scholarship for Graduate Students, Xiamen University, China, 2022
- Cho Tak Wong Scholarship, Xiamen University, China, 2021
- Outstanding prize (1st place) of the 12nd "Intel Cup" national undergraduate software innovation competition, Shanghai, China, 2019.
Education
School of Informatics, Xiamen University, M.S.
Sept. 2020 - Jun. 2023School of Informatics, Xiamen University, B.S.
Sept. 2016 - Jun. 2020
Thanks
Great thanks to my friend Yinglin Zheng (opens new window).