All geek questions in one place

Backing up GAE data / files from Blob to Google Cloud Storage / other space

In my app on Google App Engine, I have files / documents uploaded to the Blob Store. The size of the Blob store has grown to more than 100 GB.

I'm looking for a mechanism by which I can copy blob storage data, maybe in another server location or in Google cloud storage or in another safe place.

+4
source share
2 answers

AFAIK is not a simple tool that can be used to back up Blobstore data. There are at least a few approaches you could take to write your own tool:

  • Use cron.xml and a servlet (or other similar planning) to copy batches of your objects to Google Cloud Storage and then load from there (see below for tools).
  • Use a remote API or provide some other API (REST, etc.) where the remote tool you are doing can request your entities and then loads Blobs through a serving URL (which you probably already have) to your local computer.

These approaches are not very friendly, but tools like GSUtil exist , which would be useful if you would transfer your data to Google Cloud Storage (GCS). I saw a few people transfer their data now that downloads and services using GCS are supported using the Blobstore API.

It is also important to note that the file API for Blobstore is now deprecated (starting from version 1.8.1?) And that there is a new preferred path through the App Engine GCS .

Also, if you checked Messages about version 1.8.1. Preliminary versions of the SDK are available. you will see that there are some indications from Google that drops can be automatically transferred to Cloud Storage (free of charge) by the end of the year (supposedly close to when Blobstore will be out of date). Depending on the urgency of your needs, it may just be a wait.

+2
source

Source: https://habr.com/ru/post/1489793/

More articles:


All Articles