So this is weird.
I have this page that has a download control in it. Downloading the page, you select the file, and the download is normal, all the time every time.
Except that you wait two minutes after the page loads (so don't do anything for 2 minutes), the download will always work.
I started tracing the client network, and one thing I noticed was that the server response suddenly represents 401 from Microsoft-HTTPAPI-2.0 instead of IIS:

Authentication is set to Windows Authentication (in IIS 8.0)
This only happens in IE (11), Chrome doesn't seem to have this problem, so I think this is the client side.
source share