How do I back up my Google data store for efficient recovery?

Google Datastore has a backup utility . But for an online database, it’s too slow, requiring several hours to backup or restore several tens of GB. In addition, Google recommends that you turn off cloud storage records during backup, which again is not possible for the operating database.

How can I back up my data warehouse so that if there is data corruption, I can quickly recover without losing more than a few minutes of transactions?

This seems to be an integral part of any fully functional database system.

(Other databases provide this

  • storage only for applications or
  • periodic backups supplemented by a differential backup or transaction log or
  • real-time mirroring, although this does not apply to the case of data corruption from an error that is written to the database.)
+4
source share
2 answers

You won’t get a few minutes latency with an “ultimately consistent” nosql datastore like this to protect yourself from the naive backup of everything. You really have to invest in good testing to make sure that it does not contain such errors.

- , nosql-. , , .

, - .

- - , .

+2

MapReduce / . , , . , .

/ mecanism , AppEngine MapReduce 1 Cloud Dataflow 2, .

+2

Source: https://habr.com/ru/post/1653918/


All Articles