Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> size of words+counts of words getting failed.


Copy link to this message
-
size of words+counts of words getting failed.
Hello Good afternoon ,
My input file contains full of text words delimited by space.

I want to do using Pig..I already did it with map and reduce.
*I have to do:*
#get the size of words  #counts for words of particular size.

Here are commands::
a = load '/user/manish/word/word.txt' as line;
b = foreach a generate flatten(TOKENIZE(line)) as word;
c = group b by word;
d = foreach c generate group, SIZE(b.word) as size;
e = foreach c generate COUNT(b.word) as countword, group;
while i execute join command job failed....
f = join d by b.word,e by b.word;

*Error:*

ERROR 1066: Unable to open iterator for alias f

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias f
    at org.apache.pig.PigServer.openIterator(PigServer.java:857)
    at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:682)
    at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
    at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
    at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
    at org.apache.pig.Main.run(Main.java:490)
    at org.apache.pig.Main.main(Main.java:111)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.IOException: Job terminated with anomalous status FAILED
    at org.apache.pig.PigServer.openIterator(PigServer.java:849)
    ... 12 more

===============================================================================--
What to do?
Can u help me to figure this out..

Regards

Manish Dunani
skype id : manish.dunani
+
Serega Sheypak 2013-08-12, 09:11
+
manish dunani 2013-08-12, 12:47
+
Serega Sheypak 2013-08-12, 12:55
+
Bhavesh K Shah 2013-08-12, 13:03
+
manish dunani 2013-08-12, 13:22
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB