Where is emrfs-site.xml located?

Where is emrfs-site.xml on the main EMR node?

Consistent view is disabled in the EMR user interface, but I cannot find the configuration file to validate.

sudo find / -name emrfs-site.xml

gives

/var/aws/emr/bigtop-deploy/puppet/modules/emrfs/templates/emrfs-site.xml
/usr/share/aws/emr/emrfs/conf/emrfs-site.xml

None of them seem relevant.

+4
source share
1 answer

This is relevant:

/usr/share/aws/emr/emrfs/conf/emrfs-site.xml

This seems like a weird place, but the path to the configuration file is hardcoded in Java code. You can verify this by logging the root logger debug output to the console:

export HADOOP_ROOT_LOGGER="DEBUG,console

If a consistent view is included, the following should be specified in this file:

<property>
  <name>fs.s3.consistent</name>
  <value>true</value>
</property>
+4
source

Source: https://habr.com/ru/post/1621202/


All Articles