Reading csv in pig, csv file contains comma

Question

So, my data looks something like this.

asdf, asdf, "adsf,qwef", asdf 

When I read this data in a pig using

 PigStorage(',') 

It saves "adsf, qwef" as two data and saves it as

 { "adsf } { qwef" } 

I want quotes to be treated as separate data.

What should I do?

I am trying to write pigment for this.

Answer 1

You should use CSVLoader:

 data = LOAD 'my.csv' USING org.apache.pig.piggybank.storage.CSVExcelStorage() AS (...); 

Where ... are identifiers.

NOTE. First you need to register a Piggybank. Details here: https://cwiki.apache.org/confluence/display/PIG/PiggyBank