How do you use Unicode characters in a regular expression in Ruby?

Question

I am trying to write a line of code that will take a line of Japanese text and delete a specific character set. However, I am having problems using Unicode characters inside a regex.

I am currently using text.gsub(/《.*?》/u, '') , but getting an error

 'gsub': invalid byte sequence in Windows-31J (Argument error) 

Can someone tell me what I am doing wrong?

Sample text: そ の 仕 草 "し ぐ さ" が あ ま り に 無 造作 む む ぞ さ さ だ だ っ た の で

Expected Result: そ の 仕 草 が あ ま り に 無 造作 だ っ た の の

thanks

edit: # encoding: utf-8 present at the top of the script.

Answer 1

Try the following:

 text.encode('utf-8', 'utf-8').gsub(/《.*?》/u, '')