Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> size of words+counts of words getting failed.


Copy link to this message
-
Re: size of words+counts of words getting failed.
f = join d by b.word,e by b.word;
1. d doesn't have b
2. e doesn't have b
I don't understand how you try to reference them in join. looks liek you
have to join by 'group'

I suggest you to use better namings, a, b, c, d are not evident names.
Looks like you have problem with schema
2013/8/12 manish dunani <[EMAIL PROTECTED]>

> grunt> describe d;
> d: {group: chararray,size: long}
>
> grunt> describe e;
> e: {countword: long,group: chararray}
>
>
>
> On Mon, Aug 12, 2013 at 2:41 PM, Serega Sheypak <[EMAIL PROTECTED]
> >wrote:
>
> > I suggest you to output "DESCRIBE" for "d" and "e" relation.
> >
> >
> > 2013/8/12 manish dunani <[EMAIL PROTECTED]>
> >
> > > Hello Good afternoon ,
> > >
> > >
> > > My input file contains full of text words delimited by space.
> > >
> > > I want to do using Pig..I already did it with map and reduce.
> > > *I have to do:*
> > > #get the size of words  #counts for words of particular size.
> > >
> > > Here are commands::
> > > a = load '/user/manish/word/word.txt' as line;
> > > b = foreach a generate flatten(TOKENIZE(line)) as word;
> > > c = group b by word;
> > > d = foreach c generate group, SIZE(b.word) as size;
> > > e = foreach c generate COUNT(b.word) as countword, group;
> > > while i execute join command job failed....
> > > f = join d by b.word,e by b.word;
> > >
> > > *Error:*
> > >
> > > ERROR 1066: Unable to open iterator for alias f
> > >
> > > org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
> to
> > > open iterator for alias f
> > >     at org.apache.pig.PigServer.openIterator(PigServer.java:857)
> > >     at
> > >
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:682)
> > >     at
> > >
> > >
> >
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> > >     at
> > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
> > >     at
> > >
> > >
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
> > >     at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
> > >     at org.apache.pig.Main.run(Main.java:490)
> > >     at org.apache.pig.Main.main(Main.java:111)
> > >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > >     at
> > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > >     at
> > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >     at java.lang.reflect.Method.invoke(Method.java:616)
> > >     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > > Caused by: java.io.IOException: Job terminated with anomalous status
> > FAILED
> > >     at org.apache.pig.PigServer.openIterator(PigServer.java:849)
> > >     ... 12 more
> > >
> > >
> > >
> >
> ===============================================================================> > > --
> > >
> > >
> > > What to do?
> > > Can u help me to figure this out..
> > >
> > >
> > >
> > > Regards
> > >
> > > Manish Dunani
> > > skype id : manish.dunani
> > >
> >
>
>
>
> --
> Regards
>
> *Manish Dunani*
> *Contact No* : +91 9408329137
> *skype id* : manish.dunani*
> *
>