Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Invoking pig scripts from java


Copy link to this message
-
RE: Invoking pig scripts from java
Siddhi Borkar 2013-04-24, 04:33
My java program is as follows

PigServer pigServer = new PigServer(ExecType.LOCAL);
pigServer.registerScript("processor.pig");

I need to capture the output (the stack trace ) generated by the pig script and save it in a file. Is there any way to get this done?

-----Original Message-----
From: Prashant Kommireddi [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 24, 2013 12:07 AM
To: [EMAIL PROTECTED]
Subject: Re: Invoking pig scripts from java

How do you plan on running the java process? You can redirect the output to a file?
On Tue, Apr 23, 2013 at 3:15 AM, Siddhi Borkar < [EMAIL PROTECTED]> wrote:

> Thanks a lot Prashant.
> Is it possible to redirect the output generated by the pig script to a
> file? I need to do this in the java code and not in the pig scripts. I
> have some customer provided pig scripts which I am not allowed to
> modify, Hence I need to do this in java. Is there any way of doing this?
>
>
> -----Original Message-----
> From: Prashant Kommireddi [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, April 23, 2013 2:03 PM
> To: [EMAIL PROTECTED]
> Subject: Re: Invoking pig scripts from java
>
> Both are used to run pig scripts. PigRunner uses a more direct way in
> using the exact grunt code path to execute a script.
>
> PigServer on the other hand provides a bunch of helper methods that
> could be useful (for eg, setting a job name, deleting/renaming files,
> job priority, running individual queries etc). So you don't have to
> set them as properties within your script.
>
> You would use PigRunner exactly the same way as running pig via CLI
> passing the args to suggest pig script name etc, additionally it takes
> in PigProgressNotificationListener as an argument if one is interested
> in providing custom implementations of it.
>
>
> On Tue, Apr 23, 2013 at 1:17 AM, Siddhi Borkar <
> [EMAIL PROTECTED]> wrote:
>
> > Any idea what is the difference between Pigrunner and pigserver?
> >
> > -----Original Message-----
> > From: Prashant Kommireddi [mailto:[EMAIL PROTECTED]]
> > Sent: Tuesday, April 23, 2013 12:28 PM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Invoking pig scripts from java
> >
> > Have you looked at the PigServer API? Running scripts should be
> > pretty straightforward using it. Let us know if you face any issues.
> >
> >
> > http://pig.apache.org/docs/r0.11.1/api/org/apache/pig/PigServer.html
> > #r
> > egisterScript%28java.lang.String%29
> >
> >
> > On Mon, Apr 22, 2013 at 11:50 PM, Siddhi Borkar <
> > [EMAIL PROTECTED]> wrote:
> >
> > > Hi ,
> > >
> > > I need a way to invoke pig script from a java program and capture
> > > the output returned by the pig script. I was looking at the
> > > PigRunner api, however did not get much examples.
> > > Is there any way how this can be achieved?Any working examples?
> > >
> > > Thanks,
> > > Sid
> > >
> > > DISCLAIMER
> > > =========> > > This e-mail may contain privileged and confidential information
> > > which is the property of Persistent Systems Ltd. It is intended
> > > only for the use of the individual or entity to which it is
> > > addressed. If you are not the intended recipient, you are not
> > > authorized to read, retain, copy, print, distribute or use this
> > > message. If you have received this communication in error, please
> > > notify the sender and delete all copies
> > of this message.
> > > Persistent Systems Ltd. does not accept any liability for virus
> > > infected mails.
> > >
> >
> > DISCLAIMER
> > =========> > This e-mail may contain privileged and confidential information
> > which is the property of Persistent Systems Ltd. It is intended only
> > for the use of the individual or entity to which it is addressed. If
> > you are not the intended recipient, you are not authorized to read,
> > retain, copy, print, distribute or use this message. If you have
> > received this communication in error, please notify the sender and
> > delete all copies
> of this message.
> > Persistent Systems Ltd. does not accept any liability for virus

DISCLAIMER
=========This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.