Unable to create a temporary directory with the appropriate permission: / mnt1 / s3

The following is the log help for one of the containers. I got an exception stating that due to some permissions it is not possible to create a folder. I have troubleshooting at different times, but it still exists.

12/12/19 09:44:05 WARN ConfigurationUtils: cannot create temp dir with correct resolution: / mnt1 / s3

java.nio.file.AccessDeniedException: / mnt1 at sun.nio.fs.UnixException.t is here ranslateToIOException (UnixException.java:84) in sun.nio.fs.UnixException.rethrowAsIOException (UnixException.java:102) in sun.nio .fs.UnixException.rethrowAsIOException (UnixException.java:107) in sun.nio.fs.UnixFileSystemProvider.createDirectory (UnixFileSystemProvider.javahaps84) in the java.nio.file.Files.createDirectory (Files.java:674) file .nio.file.Files.createAndCheckIsDirectory (Files.java:781) in java.nio.file.Files.createDirectories (Files.java:767) in com.amazon.ws.emr.hadoop.fs.util.ConfigurationUtils.getTestedTempPaths (ConfigurationUtils.java:224) in com.amazon.ws.emr.hadoop.fs.s3n.S3NativeFileSystem.initialize (S3NativeFileSystem.java:449) in com.amazon.ws.emr.hadoop.fs.EmrFileSystem.initialize (EmrFileSystem .java: 111) in org.apache.hadoop.fs.FileSystem.createFileSystem (FileSystem.java:2717) on org.apache.hadoop.fs.FileSystem.access $ 200 (FileSystem.java:93) on org.apache.hadoop .fs.File System $ Cache.getInternal (FileSystem.java:2751) at org.apache.hadoop.fs.FileSystem $ Cache.get (FileSystem.java:2733) at org.apache.hadoop.fs.FileSystem.get (FileSystem.java: 377) in org.apache.hadoop.fs.Path.getFileSystem (Path.java:295) in org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus (FileInputFormat.java:230) in org.apache.hadoop.mapred.FileInputFormat .listStatus (FileInputFormat.java:201)

+5
source share
1 answer

you must use the same instance type for your primary and target / primary nodes

see: https://forums.aws.amazon.com/thread.jspa?threadID=57967

0
source

Source: https://habr.com/ru/post/1261498/


All Articles