|
|
-
[pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
lulynn_2008 2012-05-21, 03:03
Hi,
I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar. I have questions about them: 1. Seems the differences between these two jars are: pig-0.10.0.jar includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar just includes the dependencies besides hadoop and hadoop dependencies. Am I right? 2. How to get the jar files list in the two jar files? I mean how can I know what dependencies are included in the two jar files? 3. If I want to use hadoop jar files from a external hadoop package, should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop dependencies in pig classpath?
Thanks.
+
lulynn_2008 2012-05-21, 03:03
-
Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
IGZ Nick 2012-05-22, 08:28
1. I guess so, not sure though.. I haven't checked. 2. You can do a jar -tvf <jar file> to find out which classes are present in a particular jar. You can do a jar -xvf <jar file> to extract the jar file ot the current dir. 3. If point no. 1 is true, this should surely work!
On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <[EMAIL PROTECTED]> wrote:
> Hi, > > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and > pig-0.10.0-withouthadoop.jar. > I have questions about them: > 1. Seems the differences between these two jars are: pig-0.10.0.jar > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar just > includes the dependencies besides hadoop and hadoop dependencies. Am I > right? > 2. How to get the jar files list in the two jar files? I mean how can I > know what dependencies are included in the two jar files? > 3. If I want to use hadoop jar files from a external hadoop package, > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files > and hadoop dependencies in pig classpath? > > Thanks. >
+
IGZ Nick 2012-05-22, 08:28
-
Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
praveenesh kumar 2012-05-22, 10:25
As far as I know pig-0.10.0-withouthadoop.jar is generally used when you want to use your own distribution of hadoop to use with PIG. Having said that, yes it won't include any hadoop dependencies. If you want to use hadoop jar files from a external hadoop package, just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop dependencies in pig classpath, this is how I am doing it. Also put pig-0.10.0-wihouthadoop.jar in HADOOP_CLASSPATH also, just to be in safe side (although its not required).
Regards, Praveenesh
On Tue, May 22, 2012 at 1:58 PM, IGZ Nick <[EMAIL PROTECTED]> wrote:
> 1. I guess so, not sure though.. I haven't checked. > 2. You can do a jar -tvf <jar file> to find out which classes are present > in a particular jar. You can do a jar -xvf <jar file> to extract the jar > file ot the current dir. > 3. If point no. 1 is true, this should surely work! > > On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <[EMAIL PROTECTED]> wrote: > > > Hi, > > > > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and > > pig-0.10.0-withouthadoop.jar. > > I have questions about them: > > 1. Seems the differences between these two jars are: pig-0.10.0.jar > > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar > just > > includes the dependencies besides hadoop and hadoop dependencies. Am I > > right? > > 2. How to get the jar files list in the two jar files? I mean how can I > > know what dependencies are included in the two jar files? > > 3. If I want to use hadoop jar files from a external hadoop package, > > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files > > and hadoop dependencies in pig classpath? > > > > Thanks. > > >
+
praveenesh kumar 2012-05-22, 10:25
-
Re:Re: [pig-0.10.0]: what jar are included in pig-0.10.0.jar and pig-0.10.0-withouthadoop.jar?
lulynn_2008 2012-05-23, 03:02
Thanks. Totally agree with you.
At 2012-05-22 18:25:13,"praveenesh kumar" <[EMAIL PROTECTED]> wrote: >As far as I know pig-0.10.0-withouthadoop.jar is generally used when you >want to use your own distribution of hadoop to use with PIG. Having said >that, yes it won't include any hadoop dependencies. If you want to use >hadoop jar files from a external hadoop package, just use >pig-0.10.0-withouthadoop.jar, and put hadoop jar files and hadoop >dependencies in pig classpath, this is how I am doing it. >Also put pig-0.10.0-wihouthadoop.jar in HADOOP_CLASSPATH also, just to be >in safe side (although its not required). > >Regards, >Praveenesh > >On Tue, May 22, 2012 at 1:58 PM, IGZ Nick <[EMAIL PROTECTED]> wrote: > >> 1. I guess so, not sure though.. I haven't checked. >> 2. You can do a jar -tvf <jar file> to find out which classes are present >> in a particular jar. You can do a jar -xvf <jar file> to extract the jar >> file ot the current dir. >> 3. If point no. 1 is true, this should surely work! >> >> On Mon, May 21, 2012 at 8:33 AM, lulynn_2008 <[EMAIL PROTECTED]> wrote: >> >> > Hi, >> > >> > I found two jar files in pig-0.10.0 package: pig-0.10.0.jar and >> > pig-0.10.0-withouthadoop.jar. >> > I have questions about them: >> > 1. Seems the differences between these two jars are: pig-0.10.0.jar >> > includes all the dependencies of pig, and pig-0.10.0-withouthadoop.jar >> just >> > includes the dependencies besides hadoop and hadoop dependencies. Am I >> > right? >> > 2. How to get the jar files list in the two jar files? I mean how can I >> > know what dependencies are included in the two jar files? >> > 3. If I want to use hadoop jar files from a external hadoop package, >> > should I just use pig-0.10.0-withouthadoop.jar, and put hadoop jar files >> > and hadoop dependencies in pig classpath? >> > >> > Thanks. >> > >>
+
lulynn_2008 2012-05-23, 03:02
|
|