Decided to checkout CMU Sphinx and give it whirl. Sphinx 4 is a pure java voice recognition system. After having extracted the source code I found that I need to upgrade my ant, so I put it off temporarily.
The software requires several 'voice models' unfortunately on the sphinx 4 websites all the download links to these models point to the wrong location; the download page for sphinx 3. I have already tried out sphnx 3 without much success and I am really looking forward to sphinx4.