|
I am a final-year Ph.D. candidate from National University of Singapore, supervised by Prof. Ye Wang. I earned my B.E. degree of Electronic Engineering and B.S. degree of Finance from Tsinghua University in 2021. I am a student researcher at Google Deepmind in Singapore (was based in London, United Kingdom), where I am hosted by Petar Veliฤkoviฤ and Larisa Markeeva. I was lucky to be mentored by Tianyu Pang and Chao Du at Sea AI lab (SAIL), Singapore, where I also worked closely with Qian Liu and Min Lin. My recent research focus is to understand, advance and safely deploy generative models and agents. My next vision is to enable LLMs/agents to solve challenging problems, such as scientific discovery. I am looking for full-time positions of research scientist or member of technical staff, please contact me if you are interested in my research. Email / Google Scholar / Openreview / Linkedin / Twitter / Github |
|
|
|
|
| * denotes equal contribution, † denotes correspondence. Please see my CV or Google Scholar for full list. My representative papers are highlighted. |
| LLMs Pre-training and Attention |
|
Xiangming Gu, Tianyu Pang†, Chao Du, Qian Liu, Fengzhuo Zhang, Cunxiao Du, Ye Wang†, Min Lin International Conference on Learning Representations (ICLR), Singapore, Singapore, 2025. (Spotlight) Also in Annual Conference on Neural Information Processing Systems Workshop on Attributing Model Behavior at Scale (ATTRIB @ NeurIPS), Vancouver, Canada, 2024. (Oral) pdf / code / video / long talk / slides / poster |
|
Federico Barbero*†, รlvaro Arroyo*, Xiangming Gu, Christos Perivolaropoulos, Michael Bronstein, Petar Veliฤkoviฤ, Razvan Pascanu Conference on Language Modeling (COLM), Montreal, Canada, 2025. |
|
Tongyao Zhu, Qian Liu†, Haonan Wang, Shiqi Chen, Xiangming Gu, Tianyu Pang, Min-Yen Kan Annual Conference on Neural Information Processing Systems (NeurIPS), San Diego, USA, 2025. Also in International Conference on Learning Representations Workshop on Open Science for Foundation Models (SCI-FM @ ICLR), Singapore, Singapore, 2025. pdf / code |
| Safety/Security of LLMs and Diffusion Models |
|
Federico Barbero†, Xiangming Gu, Christopher A. Choquette-Choo, Chawin Sitawarin, Matthew Jagielski, Itay Yona, Petar Veliฤkoviฤ, Ilia Shumailov, Jamie Hayes Technical Report, 2025. |
|
Xiangming Gu*, Xiaosen Zheng*, Tianyu Pang*†, Chao Du, Qian Liu, Ye Wang†, Jing Jiang†, Min Lin International Conference on Machine Learning (ICML), Vienna, Austria, 2024. Also in International Conference on Learning Representations Workshop on Large Language Model Agents (LLMAgents @ ICLR), Vienna, Austria, 2024. pdf / project page / code / video / slides / ICML poster / GYSS poster / WIRED press |
|
Xiangming Gu, Chao Du†, Tianyu Pang†, Chongxuan Li, Min Lin, Ye Wang† Transactions on Machine Learning Research (TMLR), 2025. pdf / code |
|
Hongfu Liu†, Hengguan Huang, Xiangming Gu, Hao Wang, Ye Wang International Conference on Learning Representations (ICLR), Singapore, Singapore, 2025. Also in Annual Conference on Neural Information Processing Systems Safe Generative AI Workshop (SafeGenAI @ NeurIPS), Vancouver, Canada, 2024. (Oral) pdf / code |
| Speech/Singing and Multimodality |
|
Xiangming Gu, Longshen Ou, Wei Zeng, Jianan Zhang, Nicholas Wong, Ye Wang† ACM Transactions on Multimedia Computing Communications and Applications (TOMM), 2024. pdf / code / data |
|
Xiangming Gu, Wei Zeng, Ye Wang† ACM International Conference on Multimedia (MM), Ottawa, Canada, 2023. pdf / code / video / poster |
|
Xiangming Gu*, Longshen Ou*, Danielle Ong, Ye Wang† ACM International Conference on Multimedia (MM), Lisbon, Portugal, 2022. (Oral, Top Paper Award) pdf / appendix / project page / code / data / video / press |
|
Longshen Ou*, Xiangming Gu*, Ye Wang† International Society for Music Information Retrieval Conference (ISMIR), Bengaluru, India, 2022. pdf / code |
|
|
|
Dean's Graduate Research Excellence Award, National University of Singapore, 2024
Research Achievement Award, National University of Singapore, 2025/2022 MM'22 Top Paper Award, Association for Computing Machinery, 2022 President's Graduate Fellowship, National University of Singapore, 2021-2025 Tsinghua's Friend- Zheng Geru Scholarship (Academic Excellence Scholarship), Tsinghua University, 2018 |
|
|
|
[2025.11]: Department of Electronic Engineering, Tsinghua University and Tencent Hunyuan, invited talk on Attention Sink in LLMs and its Applications.
[2025.10]: Google Deepmind Team DL: Agent Frontier, talk on Looking into LLMs: From Tokens to Solutions. [2025.06]: Google Deepmind Team DL: Agent Frontier, talk on Understanding Attention Sink in (Large) Language Models. [2025.05]: ASAP Seminar Series, invited talk on When Attention Sink Emerges in Language Models: An Empirical View. [2025.04]: Singapore Alignment Workshop, poster presentation on Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast. [2025.02]: NUS Research Week Open House, invited talk on On the Interpretability and Safety of Generative Models . [2025.01]: Global Young Scientists Summit, poster presentation on Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast. |
|
|
|
Conference reviewer for NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL ARR, MM, IJCAI, AISTATS
Journal reviewer for TPAMI, TOMM, TASLP, RA-L |
|
|
|
Teaching Assistant, CS4347/CS5647, Sound and Music Computing, Fall 2024
Teaching Assistant, CS6212, Topics in Media, Spring 2024 Teaching Assistant, CS5242, Neural Networks and Deep Learning, Spring 2023 Teaching Assistant, CS3244, Machine Learning, Fall 2022 Teaching Assistant, CS4243, Computer Vision and Pattern Recognition, Spring 2022 |
|
|
|
I love tourism, movies, food, etc. I have been lived in ๐จ๐ณ๐ธ๐ฌ๐ฌ๐ง, and travelled to ๐น๐ญ๐ซ๐ฎ๐ต๐น๐ง๐ช๐บ๐ธ๐ญ๐ฐ๐ฒ๐พ๐จ๐ฆ๐ฆ๐ช๐ฆ๐น๐ฏ๐ต๐ญ๐บ๐จ๐ฟ๐ฎ๐น๐ป๐ฆ๐ญ๐ท๐ซ๐ท๐จ๐ญ๐ฉ๐ช๐ณ๐ฑ๐ฐ๐ท for holidays/conferences.
|
|
You've probably seen this website template before, thanks to Jon Barron. |