Chapter 5, Problem 9RQ

Explanation of Solution

Hadoop:

• “Hadoop” is a Java based, open source software framework that is used for distributed storage and distributed processing of large data sets.
• Open source means it is freely available and the source code can be changed according to user’s requirements...

Explanation of Solution

Components of Hadoop:

The main components of Hadoop are:

• Hadoop Distributed File System (HDFS)
• MapReduce
• YARN (Yet Another Source Negotiator)

Hadoop Distributed File System (HDFS)

• Hadoop Distributed File System (HDFS) is a component of Hadoop that is used to store large amount of data of various formats running on a cluster at high speeds.
• It usually works on the principle of storing less number of large files rather than huge number of small files.
• HDFS uses the write-once, read many model to achieve high throughput.
• It uses three different types of nodes: a name node to store all metadata, a data node to store fixed size data blocks, and a client node to act as an interface between user application and HDFS.

Map Reduce:

• “MapReduce” is the processing layer of Hadoop...