All geek questions in one place

Apache Hama on Amazon Elastic MapReduce

I am trying to run Apache Hama on Amazon Elastic MapReduce using https://github.com/awslabs/emr-bootstrap-actions/tree/master/hama script. However, when testing with one node master and two subordinate peer.getNumPeers() nodes, only one peer connection is reported in the BSP code. I suspect Hama is running in local mode.

Moreover, looking at the https://hama.apache.org/getting_started_with_hama.html configuration, I understand that the list of all servers must be in the hama-site.xml file for the hama.zookeeper.quorum property and also in the groomservers file. However, I am wondering if they are configured correctly in the installation script . I would really appreciate it if someone could indicate if this is a restriction in the script or if I am doing something wrong.

+5
source share
1 answer

@Madhura

Hama does not always need a groomserver file to run fully distributed mode. groomserver file is needed to start the hama cluster using only start-bspd.sh . But the emr-bootstrap hama action runs groomservers on each sub-node using the hama-daemon.sh file. The code executed in the install script is as follows.

$ /bin/hama-daemon.sh --config ${HAMA_HOME}/conf start groom

I think you need to check emr logs to see if they have an error or not.

0
source

Source: https://habr.com/ru/post/1257627/

More articles:


All Articles