lulynn_2008 2012-05-21, 03:03
IGZ Nick 2012-05-22, 08:28
-Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
praveenesh kumar 2012-05-22, 10:25
As far as I know pig-0.10.0-withouthadoop.jar is generally used when you
want to use your own distribution of hadoop to use with PIG. Having said
that, yes it won't include any hadoop dependencies. If you want to use
hadoop jar files from a external hadoop package, just use
pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop
dependencies in pig classpath, this is how I am doing it.
Also put pig-0.10.0-wihouthadoop.jar in HADOOP_CLASSPATH also, just to be
in safe side (although its not required).
On Tue, May 22, 2012 at 1:58 PM, IGZ Nick <[EMAIL PROTECTED]> wrote:
> 1. I guess so, not sure though.. I haven't checked.
> 2. You can do a jar -tvf <jar file> to find out which classes are present
> in a particular jar. You can do a jar -xvf <jar file> to extract the jar
> file ot the current dir.
> 3. If point no. 1 is true, this should surely work!
> On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <[EMAIL PROTECTED]> wrote:
> > Hi,
> > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and
> > pig-0.10.0-withouthadoop.jar.
> > I have questions about them:
> > 1. Seems the differences between these two jars are: pig-0.10.0.jar
> > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar
> > includes the dependencies besides hadoop and hadoop dependencies. Am I
> > right?
> > 2. How to get the jar files list in the two jar files? I mean how can I
> > know what dependencies are included in the two jar files?
> > 3. If I want to use hadoop jar files from a external hadoop package,
> > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files
> > and hadoop dependencies in pig classpath?
> > Thanks.
lulynn_2008 2012-05-23, 03:02