Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> A question on joins


Copy link to this message
-
Re: A question on joins
it turns out that "output" is a reserved word in Pig. if you change your
alias to "thingy" your script will work.

Barclay Dunn
On 6/19/13 3:10 AM, Sameer Tilak wrote:
> Dear Pig users,
> I am trying to do simple joins by following an example on a Blog. Your help will be great.
>  
> UserDetails.txt
> 123456, Jim
> 456123, Tom
> 789123, Harry
> 789456, Richa
>
> DeliveryDetails.txt
> 123456, 001
> 456123, 002
> 789123, 003
> 789456, 004
>
> DeliveryStatusCodes.txt
> 001, Delivered
> 002, Pending
> 003, Failed
> 004, Resend
>
> Expected o/p
> Jim Delivered
> .....
>
>
>
> grunt> userdetails = load 'UserDetails.txt' as (mobile, username);
>
> grunt> deliverydetails = load 'DeliveryDetails.txt' as (mobile , deliverycode);
>
> grunt> userdeliverydetails = join userdetails BY mobile, deliverydetails BY mobile;
>
> grunt> describe userdeliverydetails
> userdeliverydetails: {userdetails::mobile: bytearray,userdetails::username: bytearray,deliverydetails::mobile: bytearray,deliverydetails::deliverycode: bytearray}
>
> grunt> deliverystatuscodes = load 'DeliveryStatusCodes.txt' as (deliverycode, message);
>
> grunt>  output = join userdeliverydetails by $3, deliverystatuscodes by $0;
>
> 2013-06-19 00:02:31,600 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200: <line 8, column 0>  mismatched input 'output' expecting EOF
> Details at logfile: pig_1371623265656.log. I have copied the details here:
> -:---F1  *scratch*      All L1     (Fundamental)-----------------------------
> Pig Stack Trace
> ---------------
> ERROR 2997: Encountered IOException. Exception
>
> java.io.IOException: Exception
>          at org.apache.pig.PigServer.getExamples(PigServer.java:1186)
>          at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser\
> .java:739)
>          at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(Pig\
> ScriptParser.java:626)
>          at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScrip\
> tParser.java:323)
>          at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.\
> java:194)
>          at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.\
> java:170)
>          at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
>          at org.apache.pig.Main.run(Main.java:538)
>          at org.apache.pig.Main.main(Main.java:157)
> Caused by: java.lang.RuntimeException: No (valid) input data found!
>          at org.apache.pig.pen.AugmentBaseDataVisitor.visit(AugmentBaseDataVisit\
> or.java:583)
> -uu-:---F1  pig_1371623265656.log   Top L1     (Fundamental)--------------------
> Loading image...done
> Pig Stack Trace
> ---------------
> ERROR 2997: Encountered IOException. Exception
>
> java.io.IOException: Exception
>          at org.apache.pig.PigServer.getExamples(PigServer.java:1186)
>          at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.\
> java:739)
>          at org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigS\
> criptParser.java:626)
>          at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScript\
> Parser.java:323)
>          at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j\
> ava:194)
>          at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.j\
> ava:170)
>          at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
>          at org.apache.pig.Main.run(Main.java:538)
>          at org.apache.pig.Main.main(Main.java:157)
> Caused by: java.lang.RuntimeException: No (valid) input data found!
>          at org.apache.pig.pen.AugmentBaseDataVisitor.visit(AugmentBaseDataVisito\
> r.java:583)
> -uu-:---F1  pig_1371623265656.log   Top L1     (Fundamental)---------------------
> Loading image...done
> Pig Stack Trace
> ---------------
> ERROR 2997: Encountered IOException. Exception
>
> java.io.IOException: Exception
>          at org.apache.pig.PigServer.getExamples(PigServer.java:1186)
>          at org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.j\
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB