|
|
-
is there no streaming.jar file in hadoop-0.21.0??
edward choi 2010-10-05, 03:03
Hi, I've recently downloaded Hadoop-0.21.0. After the installation, I've noticed that there is no "contrib" directory that used to exist in Hadoop-0.20.2. So I was wondering if there is no "hadoop-0.21.0-streaming.jar" file in Hadoop-0.21.0. Anyone had any luck finding it? If the way to use streaming has changed in Hadoop-0.21.0, then please tell me how. Appreciate the help, thx.
Ed.
-
Re: is there no streaming.jar file in hadoop-0.21.0??
Tom White 2010-10-05, 03:34
Hi Ed,
The directory structure moved around as a result of the project splitting into three subprojects (Common, HDFS, MapReduce). The streaming jar is in mapred/contrib/streaming in the distribution.
Cheers, Tom
On Mon, Oct 4, 2010 at 8:03 PM, edward choi <[EMAIL PROTECTED]> wrote: > Hi, > I've recently downloaded Hadoop-0.21.0. > After the installation, I've noticed that there is no "contrib" directory > that used to exist in Hadoop-0.20.2. > So I was wondering if there is no "hadoop-0.21.0-streaming.jar" file in > Hadoop-0.21.0. > Anyone had any luck finding it? > If the way to use streaming has changed in Hadoop-0.21.0, then please tell > me how. > Appreciate the help, thx. > > Ed. >
-
Re: is there no streaming.jar file in hadoop-0.21.0??
edward choi 2010-10-05, 05:55
Thanks, Tom. Didn't expect the author of THE BOOK would answer my question. Very surprised and honored :-) Just one more question if you don't mind. I read it on the Internet that in order to user Hadoop Streaming in Hadoop-0.21.0 you should go "$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar args" (Of course I don't see any hadoop-streaming.jar in $HADOOP_HOME) But according to your reply I should go "$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/mapred/contrib/streaming/hadoop-*-streaming.jar args" I suppose the latter one is the way to go?
Ed.
2010/10/5 Tom White <[EMAIL PROTECTED]>
> Hi Ed, > > The directory structure moved around as a result of the project > splitting into three subprojects (Common, HDFS, MapReduce). The > streaming jar is in mapred/contrib/streaming in the distribution. > > Cheers, > Tom > > On Mon, Oct 4, 2010 at 8:03 PM, edward choi <[EMAIL PROTECTED]> wrote: > > Hi, > > I've recently downloaded Hadoop-0.21.0. > > After the installation, I've noticed that there is no "contrib" directory > > that used to exist in Hadoop-0.20.2. > > So I was wondering if there is no "hadoop-0.21.0-streaming.jar" file in > > Hadoop-0.21.0. > > Anyone had any luck finding it? > > If the way to use streaming has changed in Hadoop-0.21.0, then please > tell > > me how. > > Appreciate the help, thx. > > > > Ed. > > >
-
Re: is there no streaming.jar file in hadoop-0.21.0??
Alejandro Abdelnur 2010-10-05, 10:00
Edward,
Yep, you should use the one from contrib/
Alejandro
On Tue, Oct 5, 2010 at 1:55 PM, edward choi <[EMAIL PROTECTED]> wrote: > Thanks, Tom. > Didn't expect the author of THE BOOK would answer my question. Very > surprised and honored :-) > Just one more question if you don't mind. > I read it on the Internet that in order to user Hadoop Streaming in > Hadoop-0.21.0 you should go > "$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar args" (Of > course I don't see any hadoop-streaming.jar in $HADOOP_HOME) > But according to your reply I should go > "$HADOOP_HOME/bin/hadoop jar > $HADOOP_HOME/mapred/contrib/streaming/hadoop-*-streaming.jar args" > I suppose the latter one is the way to go? > > Ed. > > 2010/10/5 Tom White <[EMAIL PROTECTED]> > >> Hi Ed, >> >> The directory structure moved around as a result of the project >> splitting into three subprojects (Common, HDFS, MapReduce). The >> streaming jar is in mapred/contrib/streaming in the distribution. >> >> Cheers, >> Tom >> >> On Mon, Oct 4, 2010 at 8:03 PM, edward choi <[EMAIL PROTECTED]> wrote: >> > Hi, >> > I've recently downloaded Hadoop-0.21.0. >> > After the installation, I've noticed that there is no "contrib" directory >> > that used to exist in Hadoop-0.20.2. >> > So I was wondering if there is no "hadoop-0.21.0-streaming.jar" file in >> > Hadoop-0.21.0. >> > Anyone had any luck finding it? >> > If the way to use streaming has changed in Hadoop-0.21.0, then please >> tell >> > me how. >> > Appreciate the help, thx. >> > >> > Ed. >> > >> >
-
Re: is there no streaming.jar file in hadoop-0.21.0??
edward choi 2010-10-06, 00:14
Thanks for the reply Alejandro. Appreciate it.
Ed.
2010/10/5 Alejandro Abdelnur <[EMAIL PROTECTED]>
> Edward, > > Yep, you should use the one from contrib/ > > Alejandro > > On Tue, Oct 5, 2010 at 1:55 PM, edward choi <[EMAIL PROTECTED]> wrote: > > Thanks, Tom. > > Didn't expect the author of THE BOOK would answer my question. Very > > surprised and honored :-) > > Just one more question if you don't mind. > > I read it on the Internet that in order to user Hadoop Streaming in > > Hadoop-0.21.0 you should go > > "$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-streaming.jar args" (Of > > course I don't see any hadoop-streaming.jar in $HADOOP_HOME) > > But according to your reply I should go > > "$HADOOP_HOME/bin/hadoop jar > > $HADOOP_HOME/mapred/contrib/streaming/hadoop-*-streaming.jar args" > > I suppose the latter one is the way to go? > > > > Ed. > > > > 2010/10/5 Tom White <[EMAIL PROTECTED]> > > > >> Hi Ed, > >> > >> The directory structure moved around as a result of the project > >> splitting into three subprojects (Common, HDFS, MapReduce). The > >> streaming jar is in mapred/contrib/streaming in the distribution. > >> > >> Cheers, > >> Tom > >> > >> On Mon, Oct 4, 2010 at 8:03 PM, edward choi <[EMAIL PROTECTED]> wrote: > >> > Hi, > >> > I've recently downloaded Hadoop-0.21.0. > >> > After the installation, I've noticed that there is no "contrib" > directory > >> > that used to exist in Hadoop-0.20.2. > >> > So I was wondering if there is no "hadoop-0.21.0-streaming.jar" file > in > >> > Hadoop-0.21.0. > >> > Anyone had any luck finding it? > >> > If the way to use streaming has changed in Hadoop-0.21.0, then please > >> tell > >> > me how. > >> > Appreciate the help, thx. > >> > > >> > Ed. > >> > > >> > > >
|
|