Hadoop Administration Certification Training - Edureka

Comments · 173 Views

Edureka's Hadoop Administration Certification Training will guide you to gain expertise in maintaining complex Hadoop Clusters. You will learn exclusive Hadoop Admin activities like Planning of the Cluster, Installation, Cluster Configuration, Cluster Monitoring and Tuning.

Edureka's Hadoop Administration Certification Training will guide you to gain expertise in maintaining complex Hadoop Clusters. You will learn exclusive Hadoop Admin activities like Planning of the Cluster, Installation, Cluster Configuration, Cluster Monitoring and Tuning. 

HDFS Tutorial: Advantages Of HDFS

1. Distributed Storage:

When you access Hadoop Distributed file system from any of the ten machines in the Hadoop cluster, you will feel as if you have logged into a single large machine which has a storage capacity of 10 TB (total storage over ten machines). What does it mean? It means that you can store a single large file of 10 TB which will be distributed over the ten machines (1 TB each). So, it is not limited to the physical boundaries of each individual machine.

2. Distributed Parallel Computation:

Because the data is divided across the machines, it allows us to take advantage of Distributed and Parallel Computation. Let’s understand this concept by the above example. Suppose, it takes 43 minutes to process 1 TB file on a single machine. So, now tell me, how much time will it take to process the same 1 TB file when you have 10 machines in a Hadoop cluster with similar configuration – 43 minutes or 4.3 minutes? 4.3 minutes, Right! What happened here? Each of the nodes is working with a part of the 1 TB file in parallel. Therefore, the work which was taking 43 minutes before, gets finished in just 4.3 minutes now as the work got divided over ten machines.

3. Horizontal Scalability:

Last but not the least, let us talk about the horizontal scaling or scaling out in Hadoop. There are two types of scaling: vertical and horizontal. In vertical scaling (scale up), you increase the hardware capacity of your system. In other words, you procure more RAM or CPU and add it to your existing system to make it more robust and powerful.

Comments