This is a pretty old question, but as the problem persists, here it is.
There is an error in Kubernetes restclient that does not allow you to use more than one IP / URL, as it will always display the first IP address in the list. This affects kube-proxy, as well as kubelet, leaving one point of failure in these tools if you do not use a load balancer (like you) in a multi-wizard setup. The solution is probably not the most elegant solution ever, but currently (I think) it is easier.
Another solution (which I prefer, but may not work for everyone, and it does not solve all problems) is to create a DNS record that will cover your API servers, but, as indicated in one of the links below, that only solves load balancing , not HA.
You can see the progress of this story in the following links:
Kube-proxy / kubelet problem: https://github.com/kubernetes/kubernetes/issues/18174
Restclient PR: https://github.com/kubernetes/kubernetes/pull/30588
The "official" solution: https://github.com/kubernetes/kubernetes/issues/18174#issuecomment-199381822
source share