AmoebaNet: An SDN-enabled network service for big data science
By Syed Asif Raza Shah, Wenji Wu, Qiming Lu, Liang Zhang, Sajith Sasidharan, P. DeMar, C. Guok, J. Macauley, Eric Pouyoul, Jin Kim and 1 more. 2018
41 citations recorded by the source corpus.
Abstract Data transfer is now an essential function for science discoveries, particularly within big data environments. To support data transfer for big data science, there is a need for high performance, scalable, end-to-end, and programmable networks that enable science applications to use the network most efficiently. The existing network paradigm that support big data science consists of three major components: terabit networks that provide high network bandwidths, Data Transfer Nodes (DTNs) and Science DMZ architecture that bypasses the performance hotspots in typical campus networks, and on-demand secure circuits/paths reservation systems, such as ESNet OSCARS and Internet2 AL2S, which provides automated, guaranteed bandwidth service in WAN. This network paradigm has proven to be very successful. However, to reach its full potentials, we claim that existing network paradigm for big data science must address three major problems: the last mile problem, the scalability problem, and the programmability problem. To address these problems, we proposed a solution called AmoebaNet. AmoebaNet applies Software Defined Networking (SDN) technology to provide “QoS-guaranteed” network services in campus or local area networks. AmoebaNet complements existing network paradigm for big data science: it allows application to program networks at run-time for optimum performance; and, in conjunction with WAN circuits/paths reservation system such as ESNet OSCARS and Internet2 AL2S; it solves the last mile problem and the scalability problem.
Subfields: Computer Networks and Communications, Electrical and Electronic Engineering
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computer Networks and Communications
In Electrical and Electronic Engineering
Citations in the corpus
- BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search (2019, methodology): “nd PTB; however, the algorithm requires 3000 GPU days to train. NASNet spurred a number of follow-up work, eventually pushing the required computation for NAS on CIFAR-10 and PTB to under 10 GPU days [34, 27, 29, 51, 17, 15, 37]. Some of the most popular techniques for NAS include evolutionary algor”
- Local Search is State of the Art for Neural Architecture Search Benchmarks (2020, background): “NAS has gained significant attention in recent years [40], although the first few techniques have been around since at least the 1990s [22, 29].”
- Local Search is State of the Art for NAS Benchmarks (2020, background): “Neural architecture search (NAS) has gained significant attention in recent years (Kitano, 1990; Stanley and Miikkulainen, 2002; Zoph and Le, 2017), although the first few techniques have been around since at least the 1990s (Shah et al., 2018; Maziarz et al., 2018).”
- Optimal Transport Kernels for Sequential and Parallel Neural Architecture Search (2020, background): “With the increasing interest in deep learning in recent years, NAS has attracted significant research attention [9, 11, 31, 32, 33, 43, 44, 48, 55, 61, 63].”