All geek questions in one place

What will Hadoop do after one of the datanodes

I have 10 data and 2 name nodes. Hadoop cluster with customized replicas. 3, I was wondering if one of the data nodes will be able to go down, try to create lost replications on other living nodes? or just do nothing (since there are still 2 replicas left).

Add that if the data down the node returns after some time, can hasoop recognize the data on this node? Thanks!

+4
source share
1 answer

willoop try to create lost replications on other live nodes? or just do nothing (since there are still 2 replicas left).

, Hadoop . Namenode , , node . , .

, , node , hadoop node?

, node , Name node / . node node .

Apache HDFS:

DataNode Heartbeat NameNode. , DataNodes NameNode. NameNode - Heartbeat. NameNode DataNodes Heartbeats -. , DataNode, HDFS. DataNode , . NameNode , , . The necessity for re-replication may arise due to many reasons: a DataNode may become unavailable, a replica may become corrupted, a hard disk on a DataNode may fail, or the replication factor of a file may be increased.

+9

Source: https://habr.com/ru/post/1621669/

More articles:


All Articles