Vi-compliant compatibility can be established using
set backspace=
This disables the following.
indent allow backspacing over autoindent eol allow backspacing over line breaks (join lines) start allow backspacing over the start of insert; CTRL-W and CTRL-U stop once at the start of insert.
Thus, clicking on the backspace will delete only what was inserted into the current insert mode and into the current row. This makes it very difficult to delete in insert mode.
Using the default backspace option also leaves the old characters on the screen and they will not disappear until you return to normal mode.
As @Andon says it is being overwritten by your vimrc system. Therefore, you should put the string in your vimrc simply if you move it to another system that does not have the same vimrc system.
You can test vim without vimrc by running vim -u NONE and making default settings for backspace.
source share