No, this is a limitation of Windows. The "current Windows directory" for the program cannot be a UNC name, but there must be a path with a drive letter. You will need to assign a drive letter to your network.
You can do this using the usual Windows Explorer method or create a shortcut command line to automatically create a drive letter:
pushd \\server\share\path
Windows cmd, . "Git Bash Here" Windows.