In fact, you can do this using the HTML5 download attribute, if old browsers are a problem, you should use a server server for this and set the appropriate headers, etc.
<a href="http://www.glamquotes.com/wp-content/uploads/2011/11/smile.jpg" download="smile.jpg">Download image</a>
Fiddle
source share