I was going to remove this question, but here is a solution for everyone who ended up in the same situation:
The reason the application crashed was because I had an exception point configured. This is interrupted as soon as an exception occurs, and not when it bubbles up, so it actually stopped before it even reached my point. I just need to disable breakpoints (or just an exception breakpoint) when I run the tests.

source share