Borg: the next generation

By Muhammad Tirmazi, Adam Barker, Nan Deng, Md. E. Haque, Zhijing Gene Qin, S. Hand, Mor Harchol-Balter, John Wilkes. European Conference on Computer Systems, 2020

409 citations recorded by the source corpus.

This paper analyzes a newly-published trace that covers 8 different Borg [35] clusters for the month of May 2019. The trace enables researchers to explore how scheduling works in large-scale production compute clusters. We highlight how Borg has evolved and perform a longitudinal comparison of the newly-published 2019 trace against the 2011 trace, which has been highly cited within the research community. Our findings show that Borg features such as alloc sets are used for resource-heavy workloads; automatic vertical scaling is effective; job-dependencies account for much of the high failure rates reported by prior studies; the workload arrival rate has increased, as has the use of resource over-commitment; the workload mix has changed, jobs have migrated from the free tier into the best-effort batch tier; the workload exhibits an extremely heavy-tailed distribution where the top 1% of jobs consume over 99% of resources; and there is a great deal of variation between different clusters.

Subfields: Computer Networks and Communications, Information Systems

View Paper: https://www.semanticscholar.org/paper/58208a0a9992cdfe8f386f9c77d0f7882daabdf5

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Networks and Communications

In Information Systems

Citations in the corpus

Twine: A Unified Cluster Management System for Shared Infrastructure (2020, background): “Similar capacity skew exists in Borg as well [36].”
Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis (2021, background): “There exist several public traces released from production clusters including Google Trace [24, 32], Alibaba Trace [21, 31], Azure Trace [14, 25], and so on.”
Carbon-Aware Computing for Datacenters (2021, positive): “Borg uses the VCC values to compute the real-time CPU availability for incoming ﬂexible jobs.”
A Holistic Approach for Designing Carbon Aware Datacenters (2022, methodology): “Google Borg traces show that a significant fraction of the jobs submitted to the Borg scheduler are in the free and best-effort-batch tiers with weak SLAs [60].”