I plan on developing a web service that needs to be very scalable to handle many concurrent connections, perhaps thousands. The service will act as an API. It must be very responsive, a delay of 3 seconds between the request and the response is considered too large.
Perhaps the service can be distributed among many internal servers, and the load balancing gateway acts as flow control, so the actual processing of the service will not cause the gateway server to freeze. I am considering using Amazon EC2, but I can also go with an array of my own servers, so far I can find good use for them. The database will probably be MySQL (unless you have a better idea).
I understand that the best solution would be to develop my own web server, but it would take me too much time, and I doubt that I can do better than other web servers that I do not know about.
Also, I'm currently trying to decide between persistent connections or not, but I will probably stick with the latter.
So, any recommendations for a good scalable solution?
source
share