The Google file system

By Sanjay Ghemawat, H. Gobioff, Shun-Tak Leung. 2003

1,960 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Computer Networks and Communications, ML Systems & Hardware

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Networks and Communications

In ML Systems & Hardware

Citations in the corpus

Sindice.com: a document-oriented lookup index for open linked data (2008, methodology): “Sindice uses the Hadoop 12 parallel architecture, which is inspired by the job management architecture MapReduce (Dean and Ghemawat, 2004), the distributed lightweight database Bigtable (Chang et al., 2006) and the distributed ﬁlesystem GFS (Ghemawat et al., 2003).”
Pyramid Codes: Flexible Schemes to Trade Space for Access Efficiency in Reliable Data Storage Systems (2007, background): “GFS [ 9 ]) have successfully demonstrated the feasibility of building reliable data storage systems using much less reliable commodity components.”
Finding a Needle in Haystack: Facebook's Photo Storage (2010, methodology): “[9] designed the Google File System for a workload consisting mostly of append operations and large sequential reads.”
CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data (2006, methodology): “2004], Lustre [Braam 2004], and others [Rodeh and Teperman 2003; Ghemawat et al. 2003].”
Above the Clouds: A Berkeley View of Cloud Computing (2009, background): “However, because of the phenomenal growth of Web services through the early 2000’s, many large Internet companies, including Amazon, eBay, Google, Microsoft and others, were already doing so. Equally important, these companies also had to develop scalable software infrastructure (such as MapReduce, ”
Structured Comparative Analysis of Systems Logs to Diagnose Performance Problems (2012, methodology): “HBase is an open-source implementation of BigTable [5], depending on the Hadoop [19] implementation of the Google File System [17].”
Book Reviews: Data-Intensive Text Processing with MapReduce by Jimmy Lin and Chris Dyer (2010, methodology): “The Google File System (GFS) [57] supports Google’s proprietary implementation of MapReduce; in the open-source world, HDFS (Hadoop Distributed File System) is an open-source implementation of GFS that supports Hadoop.”
User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop (2010, methodology): “The Hadoop platform uses a distributed file system, Hadoop Distributed File System(HDFS)[ 11 ], to provide high throughput access to application data.”