All geek questions in one place

EMR activity stuck in Waiting_For_Runner state

I am creating a data pipeline to export a dynamoDB table to an S3 bucket. I used a standard template for use in the data pipeline console. I confirmed that the runOn field is set to the EMR cluster name to run. However, EMR activity status is still Waiting_For_Runner ... Any ideas why this is?

Thank!!!

+4
source share
1 answer

Waiting_For_Runner means that datatpipeline is trying to connect to EMR.

A few reasons you can check:

  • IAM permissions between EMR and data pipeline (Roles). Here is the link !
  • , -
    $ps -ef | grep workerGroup ( )
  • - EMR ( ) .
0

Source: https://habr.com/ru/post/1539709/

More articles:


All Articles