You will probably need more secure coding if the key / values do not exist (or the user does not have permissions to delete it), but the basics:
RegistryKey key = Registry.LocalMachine.OpenSubKey(@"SOFTWARE\Microsoft\Windows CE Services\AutoStartOnDisconnect", true);
key.DeleteValue("AutoRun", true);
source
share