Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - output


Copy link to this message
-
Re: output
Keren Ouaknine 2013-07-25, 05:33
Perfect, it worked - thanks!
On Wed, Jul 24, 2013 at 10:30 PM, Harsha <[EMAIL PROTECTED]> wrote:

> Hi Keren,
>      It looks like your load statement not working properly. Try the
> following
>  A = load '1.txt' using PigStorage(' ') as (x:double, y:chararray, z:char
> array);
> above I am using space as delimiter between columns replace it what you
> have in your file
>
> --
> Harsha
>
>
> On Wednesday, July 24, 2013 at 10:21 PM, Keren Ouaknine wrote:
>
> > Hi Prashant,
> >
> > Thanks! There's progress as I see the output directories are created but
> > the result not
> > The script:
> > A = load '1.txt' as (x:double, y:chararray, z:chararray);
> > dump A;
> > store A into '/home/kereno/Documents/pig-0.11.1/workspace/res-dump2'
> USING
> > PigStorage (',');
> >
> > My file 1.txt looks like this:
> > ~/Documents/pig-0.11.1/workspace 0$ more 1.txt
> > 1 a aleph
> > 2 b bet
> > 3 g gimel
> >
> > I am getting in part-m-0000 the following:
> > ~/Documents/pig-0.11.1/workspace 0$ more res-dump2/part-m-00000
> > ,,
> > ,,
> > ,,
> >
> > [these are all commas]
> >
> > When I ran the query from grunt the output files were stored on hdfs (I
> > guess that's the default behavior?)
> > Same output of course :)
> >
> > My question is how come the dump doesn't show the content of 1.txt?
> > By the way, my ultimate purpose is to test corner case of union but I am
> > trying to get simple dumps to work first :)
> >
> > Thanks,
> > Keren
> >
> > On Wed, Jul 24, 2013 at 8:22 PM, Prashant Kommireddi <
> [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])>wrote:
> >
> > > Can you paste your pig script here? Are you using STORE to write
> output to
> > > a certain directory?
> http://pig.apache.org/docs/r0.11.1/basic.html#store
> > >
> > >
> > > On Wed, Jul 24, 2013 at 7:47 PM, Keren Ouaknine <[EMAIL PROTECTED](mailto:
> [EMAIL PROTECTED])> wrote:
> > >
> > > > Hello,
> > > >
> > > > I am running a Pig script and completing successfully to run my
> script:
> > > >
> > > > Input(s):
> > > > Successfully read 3 records (388 bytes) from:
> > > > "hdfs://localhost:54310/user/kereno/1.txt"
> > > >
> > > > *Output(s):*
> > > > *Successfully stored 3 records (9 bytes) in:
> > > > "/home/kereno/Documents/pig-0.11.1/workspace/res-dump2"*
> > > >
> > > > *Problem:* When I lookup for the output file (res-dump2) - there is
> no
> > > such
> > > > directory.
> > > > Same problem when I ran the script or when I used grunt. My query
> loads a
> > > > simple file and dumps it!!
> > > >
> > > > Any ideas what could be the issue?
> > > > Running on Hadoop apache v1.2 and Pig 11.1
> > > >
> > > > Thanks,
> > > > Keren
> > > >
> > > > --
> > > > Keren Ouaknine
> > > > Web: www.kereno.com (http://www.kereno.com)
> > > >
> > >
> > >
> >
> >
> >
> >
> > --
> > Keren Ouaknine
> > Web: www.kereno.com (http://www.kereno.com)
> >
> >
>
>
>
--
Keren Ouaknine
Web: www.kereno.com