Mengzhou Xia

I am currently a third-year PhD student in the Department of Computer Science at Princeton University. My advisor is Prof. Danqi Chen and I am a member of Princeton Natural Language Processing Group. Prior to this, I was a master's student at Carnegie Mellon University, advised by Prof. Graham Neubig. I obtained my Bachelor's degree from Fudan University's School of Data Science in China.

I am broadly interested in improving the efficiency and performance of large pre-trained language models. Previously, I worked in the areas of low-resource NLP, multilingual learning and also meta learning. I am supported by the Bloomberg Data Science PhD Fellowship.

[Google Scholar] [Github] [CV]

Publications

• Training Trajectories of Language Models Across Scales
  Mengzhou Xia, Mikel Artetxe, Chunting Zhou, Xi Victoria Lin, Ramakanth Pasunuru, Danqi Chen, Luke Zettlemoyer, Ves Stoyanov
  preprint
  [arXiv]


• Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
  Mengzhou Xia, Mikel Artetxe, Jingfei Du, Danqi Chen, Ves Stoyanov
  EMNLP 2022
  [arXiv] [code]


• MABEL: Attenuating Gender Bias using Textual Entailment Data
  Jacqueline He, Mengzhou Xia, Christiane Fellbaum, Danqi Chen
  EMNLP 2022
  [arXiv] [code]


• Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models
  Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe
  EMNLP 2022
  [arXiv]


• Structured Pruning Learns Compact and Accurate Models
  Mengzhou Xia, Zexuan Zhong, Danqi Chen
  ACL 2022
  [arXiv] [code] [talk]


• Meta Feature Transformations for Cross-lingual Transfer Learning
  Mengzhou Xia, Guoqing Zheng, Subho Mukherjee, Graham Neubig, Ahmed Hassan Awadallah
  NAACL 2021
  [arXiv] [code]


• Non-Parametric Few-Shot Learning for Word Sense Disambiguation
  Howard Chen, Mengzhou Xia, and Danqi Chen
  NAACL 2021
  [arXiv] [code]


• Predicting Performance for Natural Language Processing Tasks
  Mengzhou Xia, Antonios Anastasopoulos, Ruochen Xu, Yiming Yang, Graham Neubig
  ACL 2020
  [arXiv] [code] [blog]


• Demoting Racial Bias in Hate Speech Detection
  Mengzhou Xia, Anjalie Field, Yulia Tsvetkov
  SocialNLP Workshop @ACL 2020
  [arXiv]


• Generalized Data Augmentation for Low-Resource Translation
  Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig
  ACL 2019
  [arXiv] [code]


• Domain Adaptation of Neural Machine Translation by Lexicon Induction
  Junjie Hu, Mengzhou Xia, Graham Neubig, Jaime Carbonell
  ACL 2019
  [arXiv] [code]


• Choosing Transfer Languages for Cross-Lingual Learning
  Yu-Hsiang Lin, Chian-Yu Chen, Jean Lee, Zirui Li, Yuyan Zhang, Mengzhou Xia, Shruti Rijhwani, Junxian He, Zhisong Zhang, Xuezhe Ma, Antonios Anastasopoulos, Patrick Littell, Graham Neubig
  ACL 2019
  [arXiv] [code]


• Graph based Translation Memory for Neural Machine Translation
  Mengzhou Xia, Guoping Huang, Lemao Liu, Shuming Shi
  AAAI 2019
  [paper]

Internship

• Microsoft Research Redmond, Research Intern, hosted by Guoqing Zheng, Summer 2020
• Tencent AI Lab, Research Intern, hosted by Lemao Liu and Guoping Huang, Summer 2018
• Google, Software Engineering Intern, Summer 2017
• Google, Engineering Practicum Intern, Summer 2016