All geek questions in one place

Hasoop file system change directory command

I went through the list of HADOOP fs commands. I am a little perplexed not to find the " cd " command in hadoop fs.

Why is that? This may seem like a silly question for HADOOP users, but since I'm new, I can't understand why there is no cd command list in the FAD HADOOP level?

+6
source share
2 answers

Think of it this way:

Hadoop has a special file system called "hdfs" that runs on top of the existing linux file system. There is no concept of the current or current working directory aka pwd

Say we have the following structure in hdfs:

d1/ d2/ f1 d3/ f2 d4/ f3

You can make cd on your Linux file system, moving from one to the other, but do you think directory change in hadoop makes sense? HDFS is like a virtual file system, and you don’t interact directly with hdf except by using the hadoop command or job tracker.

+6
source

HDFS provides various features that make it easy to access HDFS (the Hadoop file system) on local machines or edge nodes. You have the option to mount HDFS using any of the following methods. After the Hadoop file system is installed on your computer, you can use the cd command to view the file system (this is similar to creating a remote network file system such as a NAS).

  • Dfs fuse (available from Hadoop 0.20 onwards)
  • NFSv3 Gateway Access for HDFS Data (Available in Hadoop Version
    Hadoop 2.2.0)
+2
source

Source: https://habr.com/ru/post/978497/

More articles:


All Articles