Convert pandas dataframe to utf8

Question

How to convert pandas framework to Unicode?

`messages=pandas.read_csv('data/SMSSpamCollection',sep='\t',quoting=csv.QUOTE_NONE,names=["label", "message"]) def split_into_tokens(message): message = unicode(message, 'utf8') # convert bytes into proper unicode return TextBlob(message).words messages.head().apply(split_into_tokens(messages))` 

He gives an error

 Traceback (most recent call last): File "minor.py", line 46, in <module> messages.head().apply(split_into_tokens(messages)) File "minor.py", line 42, in split_into_tokens message = unicode(message, 'utf8') # convert bytes into proper unicode TypeError: coercing to Unicode: need string or buffer, DataFrame found 

Answer 1

Change code

 messages.head().apply(split_into_tokens(messages)) 

to

 messages.head().apply(split_into_tokens) 

when using "apply" with funtion, as in your case, transfer parameters are not required, as your code shows that it passes the data framework, which gives an error during execution.

Answer 2

Df.x.str.encode ('UTF-8')

Fix your problems.

http://pandas.pydata.org/pandas-docs/stable/generated/pandas.Series.str.encode.html