Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> size of words+counts of words getting failed.


Copy link to this message
-
Re: size of words+counts of words getting failed.
I suggest you to output "DESCRIBE" for "d" and "e" relation.
2013/8/12 manish dunani <[EMAIL PROTECTED]>

> Hello Good afternoon ,
>
>
> My input file contains full of text words delimited by space.
>
> I want to do using Pig..I already did it with map and reduce.
> *I have to do:*
> #get the size of words  #counts for words of particular size.
>
> Here are commands::
> a = load '/user/manish/word/word.txt' as line;
> b = foreach a generate flatten(TOKENIZE(line)) as word;
> c = group b by word;
> d = foreach c generate group, SIZE(b.word) as size;
> e = foreach c generate COUNT(b.word) as countword, group;
> while i execute join command job failed....
> f = join d by b.word,e by b.word;
>
> *Error:*
>
> ERROR 1066: Unable to open iterator for alias f
>
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias f
>     at org.apache.pig.PigServer.openIterator(PigServer.java:857)
>     at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:682)
>     at
>
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
>     at
>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
>     at
>
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>     at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
>     at org.apache.pig.Main.run(Main.java:490)
>     at org.apache.pig.Main.main(Main.java:111)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.io.IOException: Job terminated with anomalous status FAILED
>     at org.apache.pig.PigServer.openIterator(PigServer.java:849)
>     ... 12 more
>
>
> ===============================================================================> --
>
>
> What to do?
> Can u help me to figure this out..
>
>
>
> Regards
>
> Manish Dunani
> skype id : manish.dunani
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB