Skip to content

Zhanpeng Chen

Email: troychen927 [at] stu [dot] pku [dot] edu [dot] cn


I am a third-year graduate student in Computer Science at Peking University, advised by Prof. Yuexian Zou. Previously, I earned a B.A. in Environmental Engineering from Sun Yat-sen University.

My research interests include enhancing the general capabilities of Vision-Language Models (VLMs) and building AI agents that can truly perceive and interact with the world. Currently working in LongCat Foundation Model team to build frontier Omni and Vision-Language Model.

News

[12/2025] Code and paper about 3D Molecule Generation MolSculpt has been released.

[01/2025] Code and paper about improving visual position encoding PyPE has been released.

[08/2024] Code and paper about Multimodal RAG RagVL has been released.

Publications & Preprint

Preprint

MolSculpt: Sculpting 3D Molecular Geometries from Chemical Syntax

Zhanpeng Chen, Weihao Gao, Shunyu Wang, Yanan Zhu, Hong Meng, Yuexian Zou

Preprint   arXiv   Code

Publications

Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position Encoding

Zhanpeng Chen, Mingxiao Li, Ziyang Chen, Nan Du, Xiaolong Li, Yuexian Zou

ACL 2025 Findings   arXiv   Code


MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

Zhanpeng Chen, Chengjin Xu, Yiyan Qi, Jian Guo

EMNLP 2025   arXiv   Code


ToolExpNet: Optimizing Multi-Tool Selection in LLMs with Similarity and Dependency-Aware Experience Networks

Zijing Zhang, Zhanpeng Chen, He Zhu, Ziyang Chen, Nan Du, Xiaolong Li

ACL 2025 Findings   arXiv


Aspects are Anchors: Towards Multi-Modal Aspect-Based Sentiment Analysis via Aspect-Driven Alignment and Refinement

Zhanpeng Chen, Zhihong Zhu, Wanshi Xu, Yunyan Zhang, Xian Wu, Yefeng Zheng

ACM MM 2024   arXiv


Relevance Is a Guiding Light: Relevance-aware Adaptive Learning for End-to-end Task-oriented Dialogue System

Zhanpeng Chen, Zhihong Zhu, Wanshi Xu, Xianwei Zhuang, Yuexian Zou

EMNLP 2024   arXiv


Dual-oriented Disentangled Network with Counterfactual Intervention for Multimodal Intent Detection

Zhanpeng Chen, Zhihong Zhu, Xianwei Zhuang, Zhiqi Huang, Yuexian Zou

EMNLP 2024   arXiv


Towards Multimodal-augmented Pre-trained Language Models via Self-balanced Expectation-Maximization Iteration

Xianwei Zhuang, Xuxin Cheng, Zhihong Zhu, Zhanpeng Chen, Hongxiang Li, Yuexian Zou

ACM MM 2024   arXiv


Game on Tree: Visual Hallucination Mitigation via Coarse-to-Fine View Tree and Game Theory

Xianwei Zhuang, Zhihong Zhu, Zhanpeng Chen, Yuxin Xie, Liming Liang, Yuexian Zou

EMNLP 2024   arXiv   Code

Education

Peking University

Sept. 2023 -- Present

M.S. Student in Computer Science, advised by Prof. Yuexian Zou

Sun Yat-sen University

Sept. 2019 -- June 2023

B.A. in Environmental Engineering

Experience

Meituan LongCat

Mar. 2026 -- Present

Senior Engineer

ByteDance

June 2025 -- Feb. 2026

Research Intern

Xiaohongshu

Mar. 2025 -- June 2025

Research Intern

Tencent Hunyuan

Oct. 2024 -- Mar. 2025

Research Intern

IDEA Research

Mar. 2024 -- Oct. 2024

Research Intern

Academic Service

ICLR, ICML, NeurIPS, ACL, EMNLP, NAACL