Storing objects and relationships between them in HBase

I am starting a personal project, which includes storing a large database of objects and relationships between objects. I chose Hadoop and HBase because it must be multi node and most of the data is sparse.

Based on the RDBMS world, I spent a lot of time reading the HBase column-oriented structure, and given the current documentation, I find it difficult to understand how to store objects and relationships between objects.

Objects can have an unlimited number of relationships with other objects and an unlimited number of arbitrary attributes. Relations can also have attributes. My goal is to have two “Personality” objects that are connected by “Married” relations, and “Married” relations have the “Date” attribute, I would like (in the future) to write MapReduce to quickly find all the persons who are in married between x and y.

+3
source share
1 answer

There are 2 steps to follow (for me).

  • Saving Relationships
  • Data search.

Saving Relationships

  • A: . Person . , . . A, B C. A B 1/1/2000 - 1/1/2002, A C 01.01.2003 . : - : 1: - - B, : 1: - 1/1/2000, : 1: - 1/1/2002, : 2: - - C, : 2: - 1/1/2003. , .
  • B: (). , .

MapReduce, , , , . Elastic Search, Apache Solr, Apache Lucene .. , Solr, , MapReduce. .

+1

Source: https://habr.com/ru/post/1783177/


All Articles