I am currently a third-year PhD student in the Department of Computer Science at Princeton University. My advisor is Prof. Danqi Chen and I am a member of Princeton Natural Language Processing Group. Prior to this, I was a master's student at Carnegie Mellon University, advised by Prof. Graham Neubig. I obtained my Bachelor's degree from Fudan University's School of Data Science in China.
I am broadly interested in improving the efficiency and performance of large pre-trained language models. Previously, I worked in the areas of low-resource NLP, multilingual learning and also meta learning. I am supported by the Bloomberg Data Science PhD Fellowship.
[Google Scholar] [Github] [CV]
Publications
- Training Trajectories of Language Models Across Scales
Mengzhou Xia, Mikel Artetxe, Chunting Zhou, Xi Victoria Lin, Ramakanth Pasunuru, Danqi Chen, Luke Zettlemoyer, Ves Stoyanov
preprint
[arXiv]
- Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
Mengzhou Xia, Mikel Artetxe, Jingfei Du, Danqi Chen, Ves Stoyanov
EMNLP 2022
[arXiv] [code]
- MABEL: Attenuating Gender Bias using Textual Entailment Data
Jacqueline He, Mengzhou Xia, Christiane Fellbaum, Danqi Chen
EMNLP 2022
[arXiv] [code]
- Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models
Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe
EMNLP 2022
[arXiv]
- Structured Pruning Learns Compact and Accurate Models
Mengzhou Xia, Zexuan Zhong, Danqi Chen
ACL 2022
[arXiv] [code] [talk]
- Meta Feature Transformations for Cross-lingual Transfer Learning
Mengzhou Xia, Guoqing Zheng, Subho Mukherjee, Graham Neubig, Ahmed Hassan Awadallah
NAACL 2021
[arXiv] [code]
- Non-Parametric Few-Shot Learning for Word Sense Disambiguation
Howard Chen, Mengzhou Xia, and Danqi Chen
NAACL 2021
[arXiv] [code]
- Predicting Performance for Natural Language Processing Tasks
Mengzhou Xia, Antonios Anastasopoulos, Ruochen Xu, Yiming Yang, Graham Neubig
ACL 2020
[arXiv] [code] [blog]
- Demoting Racial Bias in Hate Speech Detection
Mengzhou Xia, Anjalie Field, Yulia Tsvetkov
SocialNLP Workshop @ACL 2020
[arXiv]
- Generalized Data Augmentation for Low-Resource Translation
Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig
ACL 2019
[arXiv] [code]
- Domain Adaptation of Neural Machine Translation by Lexicon Induction
Junjie Hu, Mengzhou Xia, Graham Neubig, Jaime Carbonell
ACL 2019
[arXiv] [code]
- Choosing Transfer Languages for Cross-Lingual Learning
Yu-Hsiang Lin, Chian-Yu Chen, Jean Lee, Zirui Li, Yuyan Zhang, Mengzhou Xia, Shruti Rijhwani, Junxian He, Zhisong Zhang, Xuezhe Ma, Antonios Anastasopoulos, Patrick Littell, Graham Neubig
ACL 2019
[arXiv] [code]
- Graph based Translation Memory for Neural Machine Translation
Mengzhou Xia, Guoping Huang, Lemao Liu, Shuming Shi
AAAI 2019
[paper]
Internship
- Microsoft Research Redmond, Research Intern, hosted by Guoqing Zheng, Summer 2020
- Tencent AI Lab, Research Intern, hosted by Lemao Liu and Guoping Huang, Summer 2018
- Google, Software Engineering Intern, Summer 2017
- Google, Engineering Practicum Intern, Summer 2016