Xiaosen Zheng   Ph.D. Candidate SMU, Singapore Email: xszheng2020@phdcs.smu.edu.sg; xiaosenz@andrew.cmu.edu Github: xszheng2020 [Google Scholar] [Semantic Scholar] [OpenReview] [Linkedin] [Twitter] [WeChat]

Biography

I am currently a fifth-year Ph.D. student in Computer Science at SMU, supervised by Professor Jing Jiang.

I am also a Visiting Scholar at the CX Group, LTI, CMU, under the guidance of Professor Chenyan Xiong.

My research focuses on Data-Centric AI and AI Safety.

Previously, I had the privilege of collaborating with Tianyu Pang, Chao Du, Qian Liu, and Min Lin at Sea AI Lab. I obtained my B.E. in Software Engineering from Central South University in 2019.

Preprint

(* indicates equal contribution)

• Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates
  Xiaosen Zheng*, Tianyu Pang*, Chao Du, Qian Liu, Jing Jiang, Min Lin
  arXiv, 2024
  [code] [arxiv]
• RegMix: Data Mixture as Regression for Language Model Pre-training
  Qian Liu*, Xiaosen Zheng*, Niklas Muennighoff, Guangtao Zeng, Longxu Dou, Tianyu Pang, Jing Jiang, Min Lin
  arXiv, 2024
  [code] [arxiv]

Publications

(* indicates equal contribution)

• Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses
  Xiaosen Zheng, Tianyu Pang, Chao Du, Qian Liu, Jing Jiang, Min Lin
  Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2024
  [code] [arxiv]
• Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  Xiangming Gu*, Xiaosen Zheng*, Tianyu Pang*, Chao Du, Qian Liu, Ye Wang, Jing Jiang, Min Lin
  International Conference on Machine Learning (ICML), Vienna, Austria, 2024
  [code] [arxiv]
• Intriguing Properties of Data Attribution on Diffusion Models
  Xiaosen Zheng, Tianyu Pang, Chao Du, Jing Jiang, Min Lin
  International Conference on Learning Representations (ICLR), Vienna, Austria, 2024
  [code] [arxiv]
• An Empirical Study of Memorization in NLP
  Xiaosen Zheng, Jing Jiang
  Annual Meeting of the Association for Computational Linguistics (ACL), Dublin, Ireland, 2022
  [code] [arxiv]

Honors & Awards

• Presidential Doctoral Fellowship@SMU, AY2022, AY2024

Services

I was a reviewer of conferences:
NeurIPS D&B 2024
ARR 2023 Dec, 2024 April
ACL 2023

I was a reviewer of journals:
TPAMI © 2024 Xiaosen Zheng