alt text  

Chaoyou Fu   alt text

Senior Researcher
Tencent Youtu Lab

Google Scholar  |  GitHub
Email: alt text

Biography

I am a senior researcher at Tencent Youtu Lab. Before that, I obtained my Ph.D. degree from CRIPAC-NLPR-CASIA in 2022, under the leadership of Prof. Tieniu Tan and the supervision of Prof. Ran He. I received my B.E. degree from Anhui University in 2017, where I was advised by Prof. Shuping He.


My current research interests mainly focus on multimodality (vision+language) and biometrics (face recognition+generation).


I am open to any discussion or collaboration. If you are interested, please feel free to contact me.

Selected Publications

alt text  

A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise
Chaoyou Fu [Project Leader], Renrui Zhang, Zihan Wang, Yubo Huang, Zhengye Zhang, et al
arXiv 2023, Project

alt text  

A Survey on Multimodal Large Language Models
Shukang Yin, Chaoyou Fu [Project Leader], Sirui Zhao, Ke Li, Xing Sun, Tong Xu, and Enhong Chen
arXiv 2023 (update on April 2, 2024), Project [8k+ Stars 🌟]

alt text  

MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Chaoyou Fu [Project Leader], Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, et al
arXiv 2023, Leaderboard [with 50+ MLLMs 🌟]

alt text  

Woodpecker: Hallucination Correction for Multimodal Large Language Models
Shukang Yin, Chaoyou Fu [Project Leader], Sirui Zhao, Tong Xu, et al
arXiv 2023, Code [500+ Stars 🌟]

alt text  

APE: Aligning and Prompting Everything All at Once for Universal Visual Perception
Yunhang Shen, Chaoyou Fu, Peixian Chen, Mengdan Zhang, Ke Li, Xing Sun, Yunsheng Wu, et al
CVPR 2024, Code [400+ Stars 🌟]

alt text  

Multi-Modal Queried Object Detection in the Wild
Yifan Xu, Mengdan Zhang, Chaoyou Fu, Peixian Chen, Xiaoshan Yang, Ke Li, Changsheng Xu
NeurIPS 2023, Code

alt text  

Dual Variational Generation for Low Shot Heterogeneous Face Recognition
Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, and Ran He
NeurIPS 2019, Code

alt text  

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition
Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, and Ran He
TPAMI 2022, Code

alt text  

Towards Lightweight Pixel-Wise Hallucination for Heterogeneous Face Recognition
Chaoyou Fu, Xiaoqiang Zhou, Weizan He, and Ran He
TPAMI 2023

alt text  

High Fidelity Face Manipulation with Extreme Poses and Expressions
Chaoyou Fu, Yibo Hu, Xiang Wu, Guoli Wang, Qian Zhang, and Ran He
TIFS 2021, Dataset

alt text  

CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification
Chaoyou Fu, Yibo Hu, Xiang Wu, Hailin Shi, Tao Mei, and Ran He
ICCV 2021, Code

Academic Services

Honors and Awards