The default fallback value is used for priority bindings, if you want to display "VALUE IS DEFAULT" for the fallback value, try the following.
<TextBlock Text="{Binding Fail, StringFormat=VALUE IS {0}, FallbackValue='VALUE IS DEFAULT'}" />
source share