A thought worthy of contemplation ...
Inputs
dataA:
1 (1,2)
2 (2,3)
dataB:
1 (b,c,b,c)
2 (c,d,c,d)
Pig Script:
A = LOAD 'dataA' USING PigStorage('\t') AS (aid:long, atuple : tuple(af1:long, af2:long));
B = LOAD 'dataB' USING PigStorage('\t') AS (bid:long, btuple : tuple(bf1:chararray, bf2:chararray, bf3:chararray, bf4:chararray));
C = JOIN A BY aid, B BY bid;
D = FOREACH C GENERATE aid AS id, FLATTEN(atuple) AS (af1:long, af2:long) , FLATTEN(btuple) AS (bf1:chararray, bf2:chararray, bf3:chararray, bf4:chararray);
E = FOREACH D GENERATE id, (af1..bf4);
DUMP E;
Output: DUMP E:
(1,(1,2,b,c,b,c))
(2,(2,3,c,d,c,d))
source
share