All geek questions in one place

Is it possible to use Hadoop with MongoDB as a database, not HDFS

I am researching in Hadoop with MongoDB as Database not HDFS. Therefore, I need to be guided in terms of performance and usability.

My script

My details

  • Twitter tweets
  • Facebook News feed

I can get data from Twitter and Facebook API. For handling hadoop I need to save.

So my question is: is it viable (or useful) to use Hadoop together with Mongo DB to store social network data such as twitter feeds, facebook messages, etc.? Or it’s better to go with HDFS and store the data in a file. Any expert advice will be appreciated. Thanks

+4
source share
1 answer

It is quite viable. But basically it depends on your needs. Basically, what do you want to do when you have data?

However, MongoDB is definitely a good option. This is good for storing unstructured, deeply nested documents such as JSON in your case. You do not need to worry too much about nesting and relationships in your data. You also do not need to worry about the circuit. Circuitless storage is certainly a good reason to migrate from MongoDB.

On the other hand, I find HDFS more suitable for flat files, where you just need to select the normalized data and start processing.

But these are just my thoughts. Others may have a different opinion. My final suggestion would be to analyze your use case well and then complete your store.

NTN

+1
source

Source: https://habr.com/ru/post/1500855/

More articles:


All Articles