Chapter 2, Problem 18RQ

Explanation of Solution

Hadoop:

• “Hadoop” is a Java based, open source software framework that is used for distributed storage and distributed processing of large data sets.
• Open source means, it is freely available and the source code can be changed according to users requirements.
• Hadoop uses low-cost hardware that can create clusters of thousands of computer nodes to store and process data.
• Hadoop was developed by Google to work on distributed file systems and parallel processing, which is now supported by Apache Software Foundation.

Components of Hadoop:

The main components of Hadoop are Hadoop Distributed File System (HDFS), MapReduce, and YARN (Yet Another Source Negotiator).

Hadoop Distributed File System (HDFS)

• Hadoop Distributed File System (HDFS) is a component of Hadoop that is used to store large amounts of data of various formats running on a cluster at high speeds.
• It usually works on the principle of storing less number of large files rather than huge number of small files.
• HDFS uses the write-once, read many model to achieve high throughput...