RCS has nothing to do with 'svn delete'; It does not manage directories.
You do not want to delete the RCS file (RCS / filename, v); you need this to access past work and historical versions. You just don't get (co) it anymore from RCS.
You asked about moving files. There are (at least) two options.
- - , v - , . - - .
- - , v , v; , .
2, .
, . (, 3.15 4.1) . , 1.x, - . , ( "" , 2003.2 .., , 2009.1 ..).