All geek questions in one place

Can I burn to remote HDFS?

As a title, is it possible to write to remote HDFS?

eg. I installed the HDFS cluster on AWS EC2 and I want to write the file from my local computer to the HDFS cluster.

+4
source share
1 answer

Two ways to write to remote HDFS,

  • Use WebHDFS apiavailable.It supports systems operating outside of Hadoop to access and manage HDFS content. This does not require client systems to install hadoop binaries.

  • Configure the client system Hadoop edge nodeto interact with the Hadoop cluster / HDFS.

Please contact

https://hadoop.apache.org/docs/r1.2.1/webhdfs.html

http://www.dummies.com/how-to/content/edge-nodes-in-hadoop-clusters.html

+5

Source: https://habr.com/ru/post/1609453/

More articles:


All Articles