As you probably already know, there are three steps to setting MapReduce:
- 1- , , . "" , .
Shuffle - , , Map, . , . Shuffle , , . ( ) , . , Map → Reduce tasks.
- MapReduce. "" , , (HDFS/Hive/Hbase).
, , , 396 . , . , - , 396 .
Average Map Time = Total time taken by all Map tasks/ Number of Map Tasks
,
Average Reduce Time = Total time taken by all Reduce tasks/Number of Reduce tasks
, ? , , , ( / node ..). , "" "" .
, Shuffle 40 . .
396 , . , , , . , , .
. , , , .
, , , , / , , , Heartbeat JobTracker, , NameNode, .., .
, .