Advancing Semantic Caching for LLMs with Domain-Specific Embeddings and Synthetic Data

By Waris Gill, Justin Cechmanek, Tyler Hutcherson, Srijith Rajamohan, Jen Agarwal, Muhammad Ali Gulzar, Manvinder Singh, Benoit Dion. 2025

Subfields: Large Language Models, Representation & Self-Supervised Learning, ML Systems & Hardware