Deadline-aware datacenter tcp (D2TCP)

By Balajee Vamanan, Jahangir Hasan, T. N. Vijaykumar. Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, 2012

454 citations recorded by the source corpus.

An important class of datacenter applications, called Online Data-Intensive (OLDI) applications, includes Web search, online retail, and advertisement. To achieve good user experience, OLDI applications operate under soft-real-time constraints (e.g., 300 ms latency) which imply deadlines for network communication within the applications. Further, OLDI applications typically employ tree-based algorithms which, in the common case, result in bursts of children-to-parent traffic with tight deadlines. Recent work on datacenter network protocols is either deadline-agnostic (DCTCP) or is deadline-aware (D3) but suffers under bursts due to race conditions. Further, D3 has the practical drawbacks of requiring changes to the switch hardware and not being able to coexist with legacy TCP. We propose Deadline-Aware Datacenter TCP (D2TCP), a novel transport protocol, which handles bursts, is deadline-aware, and is readily deployable. In designing D2TCP, we make two contributions: (1) D2TCP uses a distributed and reactive approach for bandwidth allocation which fundamentally enables D2TCP's properties. (2) D2TCP employs a novel congestion avoidance algorithm, which uses ECN feedback and deadlines to modulate the congestion window via a gamma-correction function. Using a small-scale implementation and at-scale simulations, we show that D2TCP reduces the fraction of missed deadlines compared to DCTCP and D3 by 75% and 50%, respectively.

Subfields: Computer Networks and Communications, Information Systems

View Paper: https://www.semanticscholar.org/paper/1c2161bb46fada992fc2ee7fe2d6c66970a2a17a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Networks and Communications

In Information Systems

Citations in the corpus

Swift: Delay is Simple and Effective for Congestion Control in the Datacenter (2020, methodology): “Hull [2] uses phantom queues, and D2TCP [52] is a deadline-aware protocol that also uses ECN.”
Homa: a receiver-driven low-latency transport protocol using network priorities (2018, methodology): “This includes rate-control techniques such as DCTCP [2] and HULL [3], which reduce queue occupancy, and D3 [32] and D2TCP [31], which incorporate deadline-awareness.”
TIMELY: RTT-based Congestion Control for the Datacenter (2015, background): “Existing datacenter transports use signals from network switches to detect the onset of congestion and run with low levels of latency and loss [15,35,37].”
Re-architecting datacenter networks and stacks for low latency and high performance (2017, background): “If one can modify applications to explicitly state deadlines, there is a wide range of proposals that will help including PDQ, Deadline-aware Datacenter TCP (D2TCP) and D3 [22, 37, 39].”
Toward Scalable Systems for Big Data Analytics: A Technology Tutorial (2014, background): “[97] proposed a deadline-aware data center TCP for bandwidth allocation, which can guarantee that network communication is finished under soft real-time constraints.”
pFabric: minimal near-optimal datacenter transport (2013, methodology): “DTCP [18], a recently proposed extension to DCTCP, adds deadline-awareness to DCTCP by modulating the window size based on both deadline information and the extent of congestion.”