The configuration data is stored in memory. However, ASP.NET will keep track of changes to web.config and recycle the application domain if the file has been modified.
In addition, all user sessions will be lost, so it is not recommended to touch web.config while the application is running.