This problem is a bit outdated, so I thought I'd add a more modern answer:
CMUSphinx is great if you have something powerful enough to run it, but if you are on an embedded device such as Pi or CHIP, it can be quite slow.
One alternative is Sonus , which has hot word detection disabled and then uses Google Cloud Speech to stream results.
source share