Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> illustrate fails after join


Copy link to this message
-
RE: illustrate fails after join
Illustrate in the current version of the pig is likely to be broken as we have not been actively maintaining it for a while. We are fixing it now and it will become part of Pig 0.9 release.

Olga

-----Original Message-----
From: Kris Coward [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, December 08, 2010 4:14 PM
To: [EMAIL PROTECTED]
Subject: illustrate fails after join

Hi again,

Now I'm having a problem where, after JOINing 2 relations, I can't get
an ILLUSTRATE to work on the resulting relation (though a DUMP is
working just fine). The error produced is:

2010-12-09 00:10:52,076 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2010-12-09 00:10:52,723 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. null Details at logfile: /home/kris/pig_1291831812543.log

the relation in question is the result of

x1 = JOIN y6 BY uid, z4 BY uid;

where y6 ilustrates as:

-----------------------------------------------
| y6     | uid: chararray  | installTime: int |
-----------------------------------------------
|        | 100000257874171 | 1265951856       |
|        | 697239231       | 1265954100       |
-----------------------------------------------

and z4 illustrates as:

---------------------------------------------------------
| z4     | uid: chararray | timestamp: int | value: int |
---------------------------------------------------------
|        | 790470383      | 1270762540     | 300        |
---------------------------------------------------------

(and both y6 and z4 have been produced by a pipeline which includes a
filter requiring (uid is not null) ).

Any ideas what might help make this work?

Thanks,
Kris

--
Kris Coward http://unripe.melon.org/
GPG Fingerprint: 2BF3 957D 310A FEEC 4733  830E 21A4 05C7 1FEB 12B3
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB