Biography

I am a Computer Science Ph.D. Student at the Center for Language and Speech Processing at Johns Hopkins University, supervised by Kevin Duh and Kenton Murray.

Previously, I was at Yale University studying math and computer science, and working with Dragomir Radev at the Yale LILY Lab. I have previously interned with Nikhil Mehta at Google/Google DeepMind in Mountain View, CA and with Maha Elbayad at Meta AI Research in Menlo Park, CA.

Interests
  • Model Compression & Efficient NLP
  • Model Merging
  • Machine Translation & Multilingual NLP
Education

  • PhD in Computer Science, 2021-present

    Johns Hopkins University

  • BSc in Computer Science & Mathematics, 2017-2021

    Yale University

Recent Publications

Neha Verma, Kenton Murray, Kevin Duh
July, 2025 arXiv
DOTResize: Reducing LLM Width via Discrete Optimal Transport-based Neuron Merging

PDF
Neha Verma, Kenton Murray, Kevin Duh
January, 2025 arXiv
Merging Feed-Forward Sublayers for Compressed Transformers

PDF
Neha Verma, Maha Elbayad
July, 2024 TMLR 2024, HiLD@ICML 2024
Merging Text Transformer Models from Different Initializations

PDF Code
Neha Verma, Kenton Murray, Kevin Duh
May, 2024 LREC-COLING 2024
Exploring Representational Disparities Between Multilingual and Bilingual Translation Models

PDF
Elizabeth Salesky, Neha Verma, Phillip Koehn, Matt Post
December, 2023 EMNLP 2023
Multilingual Pixel Representations for Translation and Effective Cross-lingual Transfer

PDF
Amir Hussein, Cihan Xiao, Neha Verma, Thomas Thebaud, Matthew Wiesner, Sanjeev Khudanpur
July, 2023 IWSLT 2023
JHU IWSLT 2023 Dialect Speech Translation System Description

PDF
Henry Li Xinyuan, Neha Verma, Bismarck Bamfo Odoom, Ujvala Pradeep, Matthew Wiesner, Sanjeev Khudanpur
July, 2023 IWSLT 2023
JHU IWSLT 2023 Multilingual Speech Translation System Description

PDF
Kelly Marchisio, Neha Verma, Kevin Duh, Philipp Koehn
December, 2022 EMNLP 2022
IsoVec: Controlling the Relative Isomorphism of Word Embedding Spaces

PDF Code
Irene Li, Jessica Pan, Jeremy Goldwasser, Neha Verma, Wai Pan Wong, Muhammed Yavuz Nuzumlalı, Benjamin Rosand, Yixin Li, Matthew Zhang, David Chang, R Andrew Taylor, Harlan M Krumholz, Dragomir Radev
November, 2022 Computer Science Review
Neural Natural Language Processing for unstructured data in electronic health records: A review

PDF
Neha Verma, Kenton Murray, Kevin Duh
September, 2022 AMTA 2022
Strategies for Adapting Multilingual Pre-training for Domain-Specific Machine Translation

PDF
Linyong Nan, Chiachun Hsieh, Ziming Mao, Xi Victoria Lin, Neha Verma, Rui Zhang, Wojciech Kryściński, Nick Schoelkopf, Riley Kong, Xiangru Tang, Mutethia Mutuma, Ben Rosand, Isabel Trindade, Renusree Bandaru, Jacob Cunningham, Caiming Xiong, Dragomir Radev
January, 2022 TACL 2022
FeTaQA: Free-form Table Question Answering

PDF Code
Linyong Nan, Dragomir Radev, Rui Zhang, Amrit Rau, Abhinand Sivaprasad, Chiachun Hsieh, Xiangru Tang, Aadit Vyas, Neha Verma, Pranav Krishna, Yangxiaokang Liu, Nadia Irwanto, Jessica Pan, Faiaz Rahman, Ahmad Zaidi, Mutethia Mutuma, Yasin Tarabar, Ankit Gupta, Tao Yu, Yi Chern Tan, Xi Victoria Lin, Caiming Xiong, Richard Socher, Nazneen Fatema Rajani
June, 2021 NAACL 2021
DART: Open-Domain Structured Data Record to Text Generation

PDF Code
Rui Zhang, Caitlin Westerfield, Sungrok Shim, Garrett Bingham, Alexander Fabbri, William Hu, Neha Verma, Dragomir Radev
July, 2019 ACL 2019
Improving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations

PDF

Contact