Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> CUBE operator


Hi All,
Any help with the following would be great!
I would like to use cube operator in my pig script:rawdata = LOAD '/structured/input.tsv';raw_data_projected = FOREACH rawdata GENERATE $2, $3, $4, $5 AS (name: chararray, age: int, prod_name: chararray, view_date: chararray);
cubed_out = CUBE raw_data_projected BY CUBE (name,age);result = FOREACH cubed_out GENERATE FLATTEN (group), COUNT_STAR(raw_data_projected);DUMP result;
I get the following error:
pig -x mapreduce cubetest.pig
Warn: Cannot open log4j properties file, use default2014-02-13 10:01:47,371 [main] INFO  org.apache.pig.Main - Apache Pig version 0.11.1 (r1459641) compiled Mar 22 2013, 02:13:532014-02-13 10:01:47,372 [main] INFO  org.apache.pig.Main - Logging error messages to: /apps/pig-scripts/pig_1392314507366.log2014-02-13 10:01:47,650 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /users/userid/.pigbootup not found2014-02-13 10:01:47,830 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://server:543102014-02-13 10:01:47,984 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: hdfs://server:543112014-02-13 10:01:48,690 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1200: nullDetails at logfile: /apps/pig-scripts/pig_1392314507366.log
Pig Stack Trace---------------ERROR 1200: null
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1000: Error during parsing. null        at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1607)        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1546)        at org.apache.pig.PigServer.registerQuery(PigServer.java:516)        at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:991)        at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:412)        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:194)        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)        at org.apache.pig.Main.run(Main.java:604)        at org.apache.pig.Main.main(Main.java:157)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:601)        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)Caused by: Failed to parse: null        at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:193)        at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1599)        ... 14 moreCaused by: java.lang.NullPointerException        at org.apache.pig.parser.LogicalPlanBuilder.convertCubeToFGPlan(LogicalPlanBuilder.java:585)        at org.apache.pig.parser.LogicalPlanBuilder.buildCubeOp(LogicalPlanBuilder.java:415)        at org.apache.pig.parser.LogicalPlanGenerator.cube_clause(LogicalPlanGenerator.java:5175)        at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1645)        at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:799)        at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:517)        at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:392)        at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:184)        ... 15 more================================================================================
     
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB