This is actually not a failure, although it appears in this way when you test your device through xCode. If you disconnect the device from your device and do another test, you will notice that when you return to your application after changing the privacy setting, the application will be killed as soon as the privacy setting changes and it will resume when you return to it.
I'm not sure about the simulator, but I guess this is the same. (The application I'm developing uses Calendar, so I have to run all my tests on the device itself)
source share