Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
Matheus Pereira
Senior Software Development Engineer
Publications
Publications by Year
-
-
Multi-Head Adapter Routing for Data-Efficient Fine-Tuning
Lucas Caccia, E. Ponti, Lu Liu, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
ArXiv | November 2023, Vol abs/2211.03831
Joint Prompt Optimization of Stacked LLMs using Variational Inference
Alessandro Sordoni, Xingdi Yuan, Marc-Alexandre Côté, Matheus Pereira, Adam Trischler, Ziang Xiao, Arian Hosseini, Friederike Niedtner, Nicolas Le Roux
NeurIPS 2023 | October 2023
Multi-Head Adapter Routing for Cross-Task Generalization
Lucas Caccia, Edoardo Ponti, Zhan Su, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
NeurIPS 2023 | October 2023
Publications by Research Area
-
Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
Multi-Head Adapter Routing for Data-Efficient Fine-Tuning
Lucas Caccia, E. Ponti, Lu Liu, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
ArXiv | November 2023, Vol abs/2211.03831
Multi-Head Adapter Routing for Cross-Task Generalization
Lucas Caccia, Edoardo Ponti, Zhan Su, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
NeurIPS 2023 | October 2023
Joint Prompt Optimization of Stacked LLMs using Variational Inference
Alessandro Sordoni, Xingdi Yuan, Marc-Alexandre Côté, Matheus Pereira, Adam Trischler, Ziang Xiao, Arian Hosseini, Friederike Niedtner, Nicolas Le Roux
NeurIPS 2023 | October 2023
Publications by Type
-
Multi-Head Adapter Routing for Data-Efficient Fine-Tuning
Lucas Caccia, E. Ponti, Lu Liu, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
ArXiv | November 2023, Vol abs/2211.03831
-
Towards Modular LLMs by Building and Reusing a Library of LoRAs
O. Ostapenko, Zhan Su, E. Ponti, Laurent Charlin, Nicolas Le Roux, Matheus Pereira, Lucas Caccia, Alessandro Sordoni
ICML 2024 | May 2024
Multi-Head Adapter Routing for Cross-Task Generalization
Lucas Caccia, Edoardo Ponti, Zhan Su, Matheus Pereira, Nicolas Le Roux, Alessandro Sordoni
NeurIPS 2023 | October 2023
Joint Prompt Optimization of Stacked LLMs using Variational Inference
Alessandro Sordoni, Xingdi Yuan, Marc-Alexandre Côté, Matheus Pereira, Adam Trischler, Ziang Xiao, Arian Hosseini, Friederike Niedtner, Nicolas Le Roux
NeurIPS 2023 | October 2023