Robust Rail Tuning Solution, Sidekiq, Redis All On AWS Elastic Beanstalk

Question

AWS Elastic Beanstalk rails app that needs sidekiq workflows that work with Puma / Passenger. Getting the sidekiq process to run led to frequent unsuccessful attempts. Also, getting the rails and sidekiq application to discuss with my AWS ElastiCache cluster seems to need some security changes.

Background

We started with an extremely simple Rails application that was easily deployed to AWAS Elastic Beanstalk. Since those early days, we developed the app to now use the Sidekiq workspace. Sidekiq, in turn, likes to use Redis to accomplish its tasks. In any case, getting all of these puzzles compiled in the AWS world is a little trickier.

Answer 1

Internet solutions ... with some sustainability issues

The AWS ecosystem goes through updates and updates, many of which are not documented with clarity. For example, environment settings change regularly; a script that you wrote may break in future versions.

I used the following solution to solve this problem:

• http://blog.noizeramp.com/2013/04/21/using-sidekiq-with-elastic-beanstalk/ (note that the comments in this blog post contain some useful tips). Many thanks to the contributor and commentators in this post.
• http://qiita.com/sawanoboly/items/d28a05d3445901cf1b25 (starting sidekiq with upstart / initctl seems like the easiest and most robust approach). This page is in Japanese, but sidekiq's startup code makes sense. Thanks!
• Use AWS ElastiCache for Redis. Be sure to configure your security groups as follows: this AWS document has been helpful ...