All geek questions in one place

Customize yarn when releasing Hadoop 2.7.4 resources

I configured hadoop 2.7.4 following this tutorial . DataNode, NameNode and SecondaryNameNode are working correctly.

But when I start the yarn, NodeManager comes with the following message

org. NodeManager

My system has 8 processors with 8 GB of RAM. How to customize yarn with these resources? I found many such as this , but could not find solutions that solve my problem.

+4
source share
1 answer

I had the same problem during the course. We used Amazon virtual machines with 2 cores .

After various modifications, yarn-site.xmlwe got our NodeManager by setting the following properties

<property>
    <name>yarn.nodemanager.resource.memory-mb</name>
    <value>4096</value>
</property>

<property>
    <name>yarn.nodemanager.resource.cpu-vcores</name>
    <value>2</value>
</property>

In your case, you may need to install 8 virtual cores.

+1
source

Source: https://habr.com/ru/post/1686029/

More articles:


All Articles