Hasoop yarn: show pending application resoure request

Question

How can I get the number of pending requests sent to the resource manager by the application? As I know, the resource manager may not immediately allocate the requested resources, so requests will be delayed, right?

Answer 1

I am using Hadoop 2.7.1. In the Resource Manager user interface, you can see "Initial Resource Requests."

In the RM interface:

• Click on the running application (e.g. application_1447644421851_0004)
• On the application page, click the attempt identifier (for example, appattempt_1447644421851_0004_000001)
• " " " Total Allocated Containers" " ".

, DistCp, 24 . , 24 + 1 (1 Application Master) = 25.

1,228 1 vCore.

:

1:

, 7 mappers , 8 (7 mappers 1 Application Master).

,

Total Allocated Containers: 8
Total Outstanding Requests: <memory: 20876, vCores:17>

, 17 (25 8). , 17 * 1228 = 20876 , vCores = 17 * 1 = 17

:

2:

7 , 7 .

:

Total Allocated Containers: 15
Total Outstanding Requests: <memory: 12280, vCores:10>

, 10 (25 15). , = 10 * 1228 = 12280 , vCores = 10 * 1 = 10

:

3:

14 7.

:

Total Allocated Containers: 22
Total Outstanding Requests: <memory: 3684, vCores:3>

, 3 (25 22). , = 3 * 1228 = 3684 , vCores = 3 * 1 = 3

:

:

, , " Total Allocated Containers".

:

, .

Answer 2

API YARN

http://<rm http address:port>/ws/v1/cluster/metrics

, .

https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Metrics_API