The easiest way to set up a docker registry is through the official docker registry . This makes it easy to start the registry server with a custom repository. As already mentioned, you can use S3 storage or Google Cloud. (I personally used the Google Cloud storage and did not encounter any problems).
I would also look at this digital docker registry setup report: How to set up a docker registry .
Since you are interested in clustering, all you need to do at this point is to configure several registry servers with the same bucket as the repository. Then install a load balancer like haproxy or nginx in front of them. This will give you the fault tolerance and load balancing you are looking for.