$result = $subject -creplace '^[^\\]*\\', ''
removes any characters without a backslash at the beginning of a line, and then a backslash:
Explanation:
^
This means that if there is more than one backslash in a line, only the first (and the text preceding it) will be deleted. If you want to delete everything until the last backslash, use
$result = $subject -creplace '(?s)^.*\\', ''
source share