Hi, my name is Weize Chen (陈纬泽(现)/陈暐泽(旧)), and I am currently a 4th-year PhD student at Tsinghua University, advised by Prof. Zhiyuan Liu. I am also a proud member of the THUNLP group. I earned my bachelor’s degree from the Department of Computer Science and Technology at Tsinghua University.

My research focuses on natural language processing (NLP) and machine learning (ML), with a particular emphasis on improving the performance and efficiency of agent systems and large language model (LLM) systems.

Specifically, my research interests lie in:

• (Multi-)Agent Systems: Designing and implementing agent systems for LLMs and MLLMs to enhance performance. My work also explores improving agent communication and cooperation for more effective collaboration.
• Inference Scaling Laws: Investigating methods to scale inference-time compute for better performance on complex reasoning tasks efficiently.

Before ChatGPT, my research interests included neural ODE/SDE, hyperbolic neural networks, and knowledge graphs. These experiences continue to inform my perspective on advancing AI.

News

• [2024-10] 🚀 Optima (Optimizing the effectiveness and efficiency of multi-agent systems) is now released! Our paper demonstrates that iterative training for multi-agent systems significantly enhances performance and efficiency, achieving up to 90% reduction in inference tokens while delivering superior performance. Moreover, with fewer inference tokens, we establish a better inference scaling law!

• [2024-07] 🚀 IoA (Internet of Agents) has been released! We introduce the concept of connecting heterogeneous and distributed agents via the Internet and present a prototype implementation functioning as an instant-messaging app for agents. Our experiments on complex agent tasks, embodied agents, and retrieval-augmented generation (RAG) demonstrate the effectiveness of IoA.

• [2024-01] 🎉 AgentVerse has been accepted to ICLR 2024! See you in Vienna! Also take a try at our GitHub repo, which now has more than 4k stars!

Highlighted Publications:

Please refer to publication for the full list.

Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System
Weize Chen*, Jiarui Yuan*, Chen Qian, Cheng Yang, Zhiyuan Liu, Maosong Sun
Preprint 2024 [project page] [pdf] [code]

Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence
Weize Chen*, Ziming You*, Ran Li*, Yitong Guan*, Chen Qian, Chenyang Zhao, Cheng Yang, Ruobing Xie, Zhiyuan Liu, Maosong Sun
Preprint 2024 [pdf] [code]

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors
Weize Chen*, Yusheng Su*, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chi-Min Chan, Heyang Yu, Yaxi Lu, Yi-Hsin Hung, Chen Qian, Yujia Qin, Xin Cong, Ruobing Xie, Zhiyuan Liu, Maosong Sun, Jie Zhou
ICLR 2024 [pdf] [code]

ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, Wei Xue, Shanghang Zhang, Jie Fu, Zhiyuan Liu
ICLR 2024 [pdf] [code]

Fully Hyperbolic Neural Networks
Weize Chen*, Xu Han*, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou
ACL 2022 [pdf] [code]