About Me
I am Yudong Zhang (张宇东), currently a Large Language Model Pre-training Algorithm Researcher at Baidu ERNIE Team.
I earned my Doctor of Philosophy (Ph.D.) degree from the Department of Electronic Engineering, Tsinghua University in 2026 under the supervision of Professor Yu Wang (汪玉), affiliated with the NICS-EFC Laboratory. I received my Bachelor’s degree from the same department in 2020, supervised by Professor Jiansheng Chen (陈健生).
My research focuses on large language model pre-training and the safety and efficiency of vision-language models. I have authored 18 papers at top-tier venues including CVPR, ICCV, AAAI, ACM-MM, EMNLP, NAACL, CIKM and TMLR. My total Google Scholar citation count is .
If you are interested in academic collaboration or wish to explore potential research opportunities, please feel free to contact me via email.
📖 Education
- Sep 2020 - Jun 2026, Ph.D., Department of Electronic Engineering, Tsinghua University, Beijing.
- Sep 2016 - Jun 2020, B.Eng., Department of Electronic Engineering, Tsinghua University, Beijing.
🔥 News
- Jun 2026: I was named a Beijing Outstanding Graduate.
- May 2025: I was featured by Tsinghua University on X (formerly Twitter) and Facebook. For details: X 1, X 2, X 3, Facebook.
-
Apr 2025: I was awarded the Excellent Intern Award from the Machine Learning Platform Department, Tencent Technology and Engineering Group (TEG).
- Dec 2024: I was named Tsinghua University 2024 Student of the Year.
💻 Work Experience
- Jul 2026 - Present, Baidu, Basic Model Research and Development Department (BMU), LLM Pre-training Department (Pre-training Algorithm Group)
, AIDU Talent Program, Beijing. - [Intern] May 2026 - Jul 2026, JD.com, JD Retail - Platform Products & R&D Center
, TGT Program Intern, Beijing. - [Intern] Apr 2024 - May 2026, Tencent, TEG Large Language Model Department, LLM Pre-training Group
, Qingyun Program Intern, Beijing. I was mentored by Xingwu Sun (孙兴武) and Ruobing Xie (谢若冰). I worked primarily on the pre-training of large language models. - [Intern] Jul 2023 - Jan 2024, Infinigence, Infrastructure Group
, Beijing. - [Intern] Jul 2021 - Aug 2021, Ministry of Education of the People’s Republic of China, China Education Television (CETV)
, Beijing. - [Intern] Jul 2019 - Aug 2019, Megvii Research
, Beijing.
📝 Publications
(* indicates equal contribution, † indicates corresponding authors.)
First-author Publications
-
Transactions on Machine Learning Research (TMLR)A Survey of Linear Attention: Algorithm, Theory, Application, and Infrastructure, Yudong Zhang*, Weixuan Sun*, Xingwu Sun, Wei Ding, Ruiqi Xie, Hongyi Wang, Junjie Chen, Jiacheng Liu, Shaobo Wang, Yuwei Zhang, Yiqing Huang, Jiaming Wang, Tianchen Zhao, Weidong Han, Yanfeng Chen, Kai Zhang, Shuaipeng Li, Ruobing Xie†, Di Wang, Jiansheng Chen, Linfeng Zhang†, Chengzhong Xu, Yu Wang† | Code -
EMNLP 2025 (Findings)The Security Threat of Compressed Projectors in Large Vision-Language Models, Yudong Zhang, Ruobing Xie†, Xingwu Sun, Jiansheng Chen†, Zhanhui Kang, Di Wang, Yu Wang† | Code | Video -
ACM-MM 2025(Oral) Fighting Fire with Fire (F3): A Training-free and Efficient Visual Adversarial Example Purification Method in LVLMs, Yudong Zhang, Ruobing Xie†, Yiqing Huang, Jiansheng Chen†, Xingwu Sun, Zhanhui Kang, Di Wang, Yu Wang† | Code | Video -
ACM-MM 2025DHCP: Detecting Hallucinations by Cross-modal Attention Pattern in Large Vision-Language Models, Yudong Zhang, Ruobing Xie†, Xingwu Sun, Yiqing Huang, Jiansheng Chen†, Zhanhui Kang, Di Wang, Yu Wang† | Code | Video -
NAACL 2025QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models, Yudong Zhang, Ruobing Xie†, Jiansheng Chen†, Xingwu Sun, Zhanhui Kang, Yu Wang† | Code | Video -
AAAI 2025Enhancing Contrastive Learning Inspired by the Philosophy of “the Blind Men and the Elephant”, Yudong Zhang, Ruobing Xie†, Jiansheng Chen†, Xingwu Sun, Zhanhui Kang, Yu Wang† | Code | Video -
ACM-MM 2024(Oral) PIP: Detecting Adversarial Examples in Large Vision-Language Models via Attention Patterns of Irrelevant Probe Questions, Yudong Zhang, Ruobing Xie†, Jiansheng Chen†, Xingwu Sun, Yu Wang† | Code | Video
Corresponding-author Publications
NeurIPS 2026Beyond Encoder Accumulation: Measuring Encoder Roles in Multi-Encoder VLMs, Wei Ding, Yudong Zhang†
First-author Preprints
PreprintMHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs, Wei Ding*, Yilin Li*, Yudong Zhang*†, Ruobing Xie, Xingwu Sun, Jiansheng Chen, Yu Wang†
Co-authored Publications and Preprints
-
EMNLP 2026Towards a Comprehensive Scaling Law of Mixture-of-Experts, Guoliang Zhao, Yuhan Fu, Shuaipeng Li, Xingwu Sun, Ruobing Xie, An Wang, Weidong Han, Zhen Yang, Weixuan Sun, Yudong Zhang, Chengzhong Xu, Di Wang, Jie Jiang -
EMNLP 2026 (Findings)Higher-Dimensional Rotary Position Embedding, Yixing Li, Ruobing Xie, Yudong Zhang, Yushi Bai, Xingwu Sun, Yu Cheng -
EMNLP 2026 (Findings)Skill-Guided Continuation Distillation for GUI Agents, Zhimin Fan, Hongwei Yu, Yeqing Shen, Haolong Yan, Guozhen Peng, Tianhao Peng, Yudong Zhang, Xiaowen Zhang, Kaijun Tan, Zheng Ge, Xiangyu Zhang, Daxin Jiang -
CVPR 2026Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentation, Yunkai Yang, Yudong Zhang, Kunquan Zhang, Jinxiao Zhang, Xinying Chen, Haohuan Fu, Runmin Dong -
ICCV 2025DADet: Safeguarding Image Conditional Diffusion Models against Adversarial and Backdoor Attacks via Diffusion Anomaly Detection, Hongwei Yu, Xinlong Ding, Jiawei Li, Jinlong Wang, Yudong Zhang, Rongquan Wang, Huimin Ma, Jiansheng Chen -
Knowledge-Based Systems (KBS)Image paragraph captioning with topic clustering and topic shift prediction, Ting Tang, Jiansheng Chen, Yiqing Huang, Huimin Ma, Yudong Zhang, Hongwei Yu -
AAAI 2024Step Vulnerability Guided Mean Fluctuation Adversarial Attack against Conditional Diffusion Models, Hongwei Yu, Jiansheng Chen, Xinlong Ding, Yudong Zhang, Ting Tang, Huimin Ma -
CIKM 2023Transferable Structure-based Adversarial Attack of Heterogeneous Graph Neural Network, Yu Shang, Yudong Zhang, Jiansheng Chen, Depeng Jin, Yong Li -
ACM-MM 20223D Human Mesh Reconstruction by Learning to Sample Joint Adaptive Tokens for Transformers, Youze Xue, Jiansheng Chen, Yudong Zhang, Cheng Yu, Huimin Ma, Hongbing Ma
🎖 Honors and Awards
Highlighted Honors
- Apr 2025: Excellent Intern Award, Machine Learning Platform Department, Tencent TEG
- Dec 2024: Tsinghua University 2024 Student of the Year (up to 10 recipients per year)
- Jun 2026: Beijing Outstanding Graduate
- Dec 2023: Tsinghua University Lin Feng Counselor Award (the highest honor for “Double-Role” Political Counselors at Tsinghua University, who simultaneously serve as graduate researchers and undergraduate counselors)
- Dec 2018: Tsinghua University Jiang Nanxiang Scholarship (the highest scholarship for junior undergraduates at Tsinghua University)
- Dec 2025: Tsinghua University Outstanding Teaching Assistant Award (up to 10 recipients per year)
- Oct 2023: Tsinghua University Outstanding Student Leader Award (Exemplary) (up to 30 recipients per year)
- Nov 2019: Tsinghua University Top 10 Volunteers (up to 10 recipients every two years)
- Dec 2024: Feng Chongxi Outstanding Scientific Research Scholarship, Department of Electronic Engineering, Tsinghua University
- Apr 2025: First-Class and Third-Class Awards of the 35th Tsinghua University Student Laboratory Construction Contribution Award (as primary contributor)
Other Honors
- Dec 2022: Tsinghua University “December 9th” Counselor Award
- Dec 2024: Graduate Student “Electronic Star”, Department of Electronic Engineering, Tsinghua University (up to 5 recipients per year)
- Dec 2019: Undergraduate Student “Electronic Star”, Department of Electronic Engineering, Tsinghua University (up to 5 recipients per year)
- Oct 2025: Lu Dajin and Liu Runsheng Excellent Teaching Assistant Award (Grand Prize), Department of Electronic Engineering, Tsinghua University
- Oct 2022: Lu Dajin and Liu Runsheng Excellent Teaching Assistant Award (Grand Prize), Department of Electronic Engineering, Tsinghua University
- Jul 2026: Tsinghua University Merit Student Award
- Oct 2020, Oct 2021, Oct 2022: Tsinghua University Outstanding Student Leader Award (three-time recipient)
- Sep 2020: As the team leader, I led the Tsinghua University Science and Technology Service Team to win the Tan Haoqiang Computer Education Foundation Scholarship - Excellent Student Group Award
- Tsinghua University Comprehensive Excellent Scholarship (twice during undergraduate studies, five times during doctoral studies)
- Tsinghua University Technological Innovation Excellence Award, Volunteer and Public Welfare Excellence Award, Social Work Excellence Award (twice), Tsinghua Friends - YOFC Scholarship (First-Class and Second-Class)
🔧 Patents
Chinese Patents (Granted)
- Kubernetes Container Access Method, Device, Computing Device, and Storage Medium (Patent No.: CN118041704B), Yu Wang, Yudong Zhang.
-
Distributed Task Dynamic Service Discovery Method, Device, and Task Training System (Patent No.: CN118041866B), Yu Wang, Yudong Zhang.
- Sample Purification Method, Device, Equipment, and Medium (Patent No.: CN118865024B), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
- Model Hallucination Detection Method, Device, Equipment, Storage Medium, and Program Product (Patent No.: CN118887474B), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
- Text Generation Method, Device, Equipment, and Readable Storage Medium (Patent No.: CN118865423B), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
Chinese Patents (Pending)
- Adversarial Sample Image Generation Method, Device, Computer Equipment, and Storage Medium (Publication No.: CN121459011A), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
- Image Processing Method and Related Equipment (Publication No.: CN121482522A), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
- Image Processing Method, Device, Equipment, Readable Storage Medium, and Program Product (Publication No.: CN121526893A), Yudong Zhang, Ruobing Xie, Xingwu Sun, Zhanhui Kang.
- Attention Processing Method, Device, Computer Equipment, Medium, and Product (Application No.: 202610581625.4), Yudong Zhang, Ruobing Xie, Xingwu Sun.
🧑🏫 Teaching
Teaching assistant for the course “Data and Algorithms” in the Department of Electronic Engineering, Tsinghua University
- Served for 6 consecutive years (Spring 2021 – Spring 2026)
✍️ Academic Service
Conference and Journal Reviewing
- ARR (ACL/EMNLP/NAACL)
- CVPR, ICCV, ECCV, BMVC
- ICLR, NeurIPS, AAAI, ACM-MM
- Pattern Recognition
- Transactions on Information Forensics & Security