3

ORBIT: Preserving Foundational Language Capabilities in GenRetrieval via Origin-Regulated Merging
Neha Verma, Nikhil Mehta, Shao-Chuan Wang, Naijing Zhang, Alicia Tsai, Aniruddh Nath, Lukasz Heldt, Lichan Hong, Ed Chi, Xinyang Yi
PDF
DOTResize: Reducing LLM Width via Discrete Optimal Transport-based Neuron Merging
Neha Verma, Kenton Murray, Kevin Duh
PDF
Merging Feed-Forward Sublayers for Compressed Transformers
Neha Verma, Kenton Murray, Kevin Duh
PDF