Reshmi Ghosh

Senior Applied Scientist

Publications

View by:

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh

EMNLP 2024, BlackBox NLP workshop | November 2024

Publication

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Edoardo Debenedetti, Javier Rando, Daniel Paleka, Fineas Silaghi, Dragos Albastroiu, Niv Cohen, Yuval Lemberg, Reshmi Ghosh, Ahmed Salem, Rui Wen, Giovanni Cherubin, Santiago Zanella-Béguelin, Robin Schmid, Victor Klemm, Takahiro Miki, Chenhao Li, Stefan Kraft, Mario Fritz, Florian Tramer, Sahar Abdelnabi, Lea Schönherr

NeurIPS 2024 | June 2024

Preprint Project
On Surgical Fine-tuning for Language Encoder

Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitry Petrov, Soundararajan Srinivasan

EMNLP 2023 | October 2023

Publication
Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Reshmi Ghosh, Harjeet Singh Kajal, Sharanya Kamath, Dhuri Shrivastava, Samyadeep Basu, Soundararajan Srinivasan

2022 Neural Information Processing Systems | December 2022

Publication

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh

EMNLP 2024, BlackBox NLP workshop | November 2024

Publication

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Edoardo Debenedetti, Javier Rando, Daniel Paleka, Fineas Silaghi, Dragos Albastroiu, Niv Cohen, Yuval Lemberg, Reshmi Ghosh, Ahmed Salem, Rui Wen, Giovanni Cherubin, Santiago Zanella-Béguelin, Robin Schmid, Victor Klemm, Takahiro Miki, Chenhao Li, Stefan Kraft, Mario Fritz, Florian Tramer, Sahar Abdelnabi, Lea Schönherr

NeurIPS 2024 | June 2024

Preprint Project

On Surgical Fine-tuning for Language Encoder

Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitry Petrov, Soundararajan Srinivasan

EMNLP 2023 | October 2023

Publication
Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh

EMNLP 2024, BlackBox NLP workshop | November 2024

Publication

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication

On Surgical Fine-tuning for Language Encoder

Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitry Petrov, Soundararajan Srinivasan

EMNLP 2023 | October 2023

Publication

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Reshmi Ghosh, Harjeet Singh Kajal, Sharanya Kamath, Dhuri Shrivastava, Samyadeep Basu, Soundararajan Srinivasan

2022 Neural Information Processing Systems | December 2022

Publication
Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh

EMNLP 2024, BlackBox NLP workshop | November 2024

Publication

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication
From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication

On Surgical Fine-tuning for Language Encoder

Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitry Petrov, Soundararajan Srinivasan

EMNLP 2023 | October 2023

Publication
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Edoardo Debenedetti, Javier Rando, Daniel Paleka, Fineas Silaghi, Dragos Albastroiu, Niv Cohen, Yuval Lemberg, Reshmi Ghosh, Ahmed Salem, Rui Wen, Giovanni Cherubin, Santiago Zanella-Béguelin, Robin Schmid, Victor Klemm, Takahiro Miki, Chenhao Li, Stefan Kraft, Mario Fritz, Florian Tramer, Sahar Abdelnabi, Lea Schönherr

NeurIPS 2024 | June 2024

Preprint Project

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Hitesh Wadhwa, Rahul Seetharaman, Somyaa Aggarwal, Reshmi Ghosh, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh, Reshmi Ghosh

ArXiv | June 2024, Vol abs/2406.12824

DOI Publication Publication
Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal, Samyadeep Basu, Soundararajan Srinivasan, Wenlong Zhao, Shreyas Chaudhari, Ehsan Aghazadeh

EMNLP 2024, BlackBox NLP workshop | November 2024

Publication

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

Edoardo Debenedetti, Javier Rando, Daniel Paleka, Fineas Silaghi, Dragos Albastroiu, Niv Cohen, Yuval Lemberg, Reshmi Ghosh, Ahmed Salem, Rui Wen, Giovanni Cherubin, Santiago Zanella-Béguelin, Robin Schmid, Victor Klemm, Takahiro Miki, Chenhao Li, Stefan Kraft, Mario Fritz, Florian Tramer, Sahar Abdelnabi, Lea Schönherr

NeurIPS 2024 | June 2024

Preprint Project

On Surgical Fine-tuning for Language Encoder

Abhilasha Lodha, Gayatri Belapurkar, Saloni Chalkapurkar, Yuanming Tao, Reshmi Ghosh, Samyadeep Basu, Dmitry Petrov, Soundararajan Srinivasan

EMNLP 2023 | October 2023

Publication

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Reshmi Ghosh, Harjeet Singh Kajal, Sharanya Kamath, Dhuri Shrivastava, Samyadeep Basu, Soundararajan Srinivasan

2022 Neural Information Processing Systems | December 2022

Publication

Reshmi Ghosh

Publications

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

On Surgical Fine-tuning for Language Encoder

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

On Surgical Fine-tuning for Language Encoder

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

On Surgical Fine-tuning for Language Encoder

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

On Surgical Fine-tuning for Language Encoder

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition

On Surgical Fine-tuning for Language Encoder

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Contact Reshmi Ghosh

Microsoft Research Lab – New England

Reshmi Ghosh

Publications

Publications by Year

2024

2023

2022

Publications by Research Area

Artificial intelligence

Human language technologies

Search and information retrieval

Technology for emerging markets

Security, privacy, and cryptography

Publications by Type

Article (Journal)

Inproceedings (Conference)