Transfer files from Dropbox / Drive to Google Cloud Storage

Question

We plan to introduce a feature that allows customers to view their images in their own Google or Dropbox accounts (in our application) and select the ones they want to use in our application. We will then save these images to our Google Cloud Storage Facility (GCS).

A simple approach is to use OAuth to upload client images from Dropbox / Drive to our local drive, and then upload them to our GCS.

I am wondering if it is possible to make a direct transfer between Dropbox / Drive and GCS? GCS provides a transmission service for S3. You can also create a list of URLs, but each URL should be publicly available, which in our case is not possible.

Is there a better suggestion on how to implement this feature? Thanks

Answer 1

Well, you can transfer files, at least you would not need to save them to a local drive, but other than that, I think your solution is the way to go.

Depending on your language, how streaming works exactly, but basically you upload the file and upload it to GCS right away without writing any bytes to the local disk.

Answer 2

I came across your question while searching for a way to transfer data from a G-drive to Google Cloud Storage. Since both of them are under the umbrella of Google, I assume that they should be able to freely download / upload. While in my search, without programming, the answer is NO.

I do not have the exact solution for your question, because it really depends on how much data you have and how often it is downloaded / loaded. Unfortunately, there is no direct shot (even for Gdrive!). But maybe it’s worth considering the RESTful API attempt to contact Google and establish a connection to the Dropbox API. Hope this helps.