Understanding and Co-designing the Data Ingestion Pipeline for Industry-Scale RecSys Training

By Mark Zhao, Niket Agarwal, Aarti Basant, Bugra Gedik, S. Pan, Mustafa Ozdal, Rakesh Komuravelli, Jerry Pan, Jerry Y. Pan, Tianshu Bao and 8 more. 2021

14 citations recorded by the source corpus.

Subfields: Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Evaluation & Benchmarks

1. Michael G. Rabbat
2. Bilge Acun
3. Newsha Ardalani
4. Carole-Jean Wu
5. Maximilian Balandat
6. Myle Ott

Citations in the corpus

• Sustainable AI: Environmental Implications, Challenges and Opportunities (2021, background): “By doing so, the resource requirement for the data storage and ingestion pipeline can be significantly reduced [44] — lower training time (operational carbon footprint) as well as storage needs (embodied carbon footprint).”