Hi,

  I downloaded the Hadoop-0.23.3 source and tweaked a few classes and
when I built the binary distribution and untar'd it .I don't see the
mapred-site.xml
file in the /etc/hadoop directory. But by the details given on how to run
the
Hadoop-0.23.3 the mapred-site.xml needs to be configured right?

  So I was just wondering if we are supposed to create the mapred-site.xml
, or
it doesn't exist at all? Thanks

--

--With Regards
Pavan Kulkarni

That may be something that we missed, as I have been providing my own
marped-site.xml for quite a while now.  Have you tried it with branch-2 or
trunk to see if they are providing it?  In either case it is just going to
be a template for you to fill in, but it would be nice to package that
template for our users to follow.  If you want to file a JIRA for that it
would be good, but I don't know how quickly we will be able to get around
to doing it.

--Bobby Evans

On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:

>Hi,
>
>  I downloaded the Hadoop-0.23.3 source and tweaked a few classes and
>when I built the binary distribution and untar'd it .I don't see the
>mapred-site.xml
>file in the /etc/hadoop directory. But by the details given on how to run
>the
>Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
>
>  So I was just wondering if we are supposed to create the mapred-site.xml
>, or
>it doesn't exist at all? Thanks
>
>--
>
>--With Regards
>Pavan Kulkarni

Bobby,

  Thanks a lot for your clarification.
Yes as you said it is just a template, but it may
be quite confusing to new users while configuring.
I have raised the Issue <https://issues.apache.org/jira/browse/HADOOP-8575>,
in case you might want to
have a look.Thanks

 Also I wanted to know is there a good source where I can
look upto for running a multi-node 2nd generation Hadoop ?
All I find is 1st generation Hadoop setup.

On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]> wrote:

> That may be something that we missed, as I have been providing my own
> marped-site.xml for quite a while now.  Have you tried it with branch-2 or
> trunk to see if they are providing it?  In either case it is just going to
> be a template for you to fill in, but it would be nice to package that
> template for our users to follow.  If you want to file a JIRA for that it
> would be good, but I don't know how quickly we will be able to get around
> to doing it.
>
> --Bobby Evans
>
> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>
> >Hi,
> >
> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes and
> >when I built the binary distribution and untar'd it .I don't see the
> >mapred-site.xml
> >file in the /etc/hadoop directory. But by the details given on how to run
> >the
> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
> >
> >  So I was just wondering if we are supposed to create the mapred-site.xml
> >, or
> >it doesn't exist at all? Thanks
> >
> >--
> >
> >--With Regards
> >Pavan Kulkarni
>
>
--

--With Regards
Pavan Kulkarni

Sorry I don't know of a good source for that right now.  Perhaps others on
the list might know better then I do.

On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:

>Bobby,
>
>  Thanks a lot for your clarification.
>Yes as you said it is just a template, but it may
>be quite confusing to new users while configuring.
>I have raised the Issue
><https://issues.apache.org/jira/browse/HADOOP-8575>,
>in case you might want to
>have a look.Thanks
>
> Also I wanted to know is there a good source where I can
>look upto for running a multi-node 2nd generation Hadoop ?
>All I find is 1st generation Hadoop setup.
>
>On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]> wrote:
>
>> That may be something that we missed, as I have been providing my own
>> marped-site.xml for quite a while now.  Have you tried it with branch-2
>>or
>> trunk to see if they are providing it?  In either case it is just going
>>to
>> be a template for you to fill in, but it would be nice to package that
>> template for our users to follow.  If you want to file a JIRA for that
>>it
>> would be good, but I don't know how quickly we will be able to get
>>around
>> to doing it.
>>
>> --Bobby Evans
>>
>> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>>
>> >Hi,
>> >
>> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes and
>> >when I built the binary distribution and untar'd it .I don't see the
>> >mapred-site.xml
>> >file in the /etc/hadoop directory. But by the details given on how to
>>run
>> >the
>> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
>> >
>> >  So I was just wondering if we are supposed to create the
>>mapred-site.xml
>> >, or
>> >it doesn't exist at all? Thanks
>> >
>> >--
>> >
>> >--With Regards
>> >Pavan Kulkarni
>>
>>
>
>
>--
>
>--With Regards
>Pavan Kulkarni

Hi Robert,

 Can you please share what all configuration files are mandatory for the
hadoop-0.23.3 to work.
I am tuning a few but still not able to set it up completely.Thanks

On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans <[EMAIL PROTECTED]> wrote:

> Sorry I don't know of a good source for that right now.  Perhaps others on
> the list might know better then I do.
>
> On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>
> >Bobby,
> >
> >  Thanks a lot for your clarification.
> >Yes as you said it is just a template, but it may
> >be quite confusing to new users while configuring.
> >I have raised the Issue
> ><https://issues.apache.org/jira/browse/HADOOP-8575>,
> >in case you might want to
> >have a look.Thanks
> >
> > Also I wanted to know is there a good source where I can
> >look upto for running a multi-node 2nd generation Hadoop ?
> >All I find is 1st generation Hadoop setup.
> >
> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]> wrote:
> >
> >> That may be something that we missed, as I have been providing my own
> >> marped-site.xml for quite a while now.  Have you tried it with branch-2
> >>or
> >> trunk to see if they are providing it?  In either case it is just going
> >>to
> >> be a template for you to fill in, but it would be nice to package that
> >> template for our users to follow.  If you want to file a JIRA for that
> >>it
> >> would be good, but I don't know how quickly we will be able to get
> >>around
> >> to doing it.
> >>
> >> --Bobby Evans
> >>
> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
> >>
> >> >Hi,
> >> >
> >> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes and
> >> >when I built the binary distribution and untar'd it .I don't see the
> >> >mapred-site.xml
> >> >file in the /etc/hadoop directory. But by the details given on how to
> >>run
> >> >the
> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
> >> >
> >> >  So I was just wondering if we are supposed to create the
> >>mapred-site.xml
> >> >, or
> >> >it doesn't exist at all? Thanks
> >> >
> >> >--
> >> >
> >> >--With Regards
> >> >Pavan Kulkarni
> >>
> >>
> >
> >
> >--
> >
> >--With Regards
> >Pavan Kulkarni
>
>
--

--With Regards
Pavan Kulkarni

On 2.0 core-site, yarn-site, hdfs-site, and mapped-site are all kind of
needed.  The exact configs that you need to set may very a lot based off
of what you are trying to do.
--Bobby Evans

On 7/6/12 6:58 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:

>Hi Robert,
>
> Can you please share what all configuration files are mandatory for the
>hadoop-0.23.3 to work.
>I am tuning a few but still not able to set it up completely.Thanks
>
>On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans <[EMAIL PROTECTED]> wrote:
>
>> Sorry I don't know of a good source for that right now.  Perhaps others
>>on
>> the list might know better then I do.
>>
>> On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>>
>> >Bobby,
>> >
>> >  Thanks a lot for your clarification.
>> >Yes as you said it is just a template, but it may
>> >be quite confusing to new users while configuring.
>> >I have raised the Issue
>> ><https://issues.apache.org/jira/browse/HADOOP-8575>,
>> >in case you might want to
>> >have a look.Thanks
>> >
>> > Also I wanted to know is there a good source where I can
>> >look upto for running a multi-node 2nd generation Hadoop ?
>> >All I find is 1st generation Hadoop setup.
>> >
>> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]>
>>wrote:
>> >
>> >> That may be something that we missed, as I have been providing my own
>> >> marped-site.xml for quite a while now.  Have you tried it with
>>branch-2
>> >>or
>> >> trunk to see if they are providing it?  In either case it is just
>>going
>> >>to
>> >> be a template for you to fill in, but it would be nice to package
>>that
>> >> template for our users to follow.  If you want to file a JIRA for
>>that
>> >>it
>> >> would be good, but I don't know how quickly we will be able to get
>> >>around
>> >> to doing it.
>> >>
>> >> --Bobby Evans
>> >>
>> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>> >>
>> >> >Hi,
>> >> >
>> >> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes
>>and
>> >> >when I built the binary distribution and untar'd it .I don't see the
>> >> >mapred-site.xml
>> >> >file in the /etc/hadoop directory. But by the details given on how
>>to
>> >>run
>> >> >the
>> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
>> >> >
>> >> >  So I was just wondering if we are supposed to create the
>> >>mapred-site.xml
>> >> >, or
>> >> >it doesn't exist at all? Thanks
>> >> >
>> >> >--
>> >> >
>> >> >--With Regards
>> >> >Pavan Kulkarni
>> >>
>> >>
>> >
>> >
>> >--
>> >
>> >--With Regards
>> >Pavan Kulkarni
>>
>>
>
>
>--
>
>--With Regards
>Pavan Kulkarni

Thanks a lot Robert. I also assume we need to set JAVA_HOME parameter in
the hadoop-env.sh .
I couldn't find this file as default just like mapred-site.xml.Am I correct?

On Mon, Jul 9, 2012 at 12:36 PM, Robert Evans <[EMAIL PROTECTED]> wrote:

> On 2.0 core-site, yarn-site, hdfs-site, and mapped-site are all kind of
> needed.  The exact configs that you need to set may very a lot based off
> of what you are trying to do.
> --Bobby Evans
>
> On 7/6/12 6:58 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>
> >Hi Robert,
> >
> > Can you please share what all configuration files are mandatory for the
> >hadoop-0.23.3 to work.
> >I am tuning a few but still not able to set it up completely.Thanks
> >
> >On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans <[EMAIL PROTECTED]>
> wrote:
> >
> >> Sorry I don't know of a good source for that right now.  Perhaps others
> >>on
> >> the list might know better then I do.
> >>
> >> On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
> >>
> >> >Bobby,
> >> >
> >> >  Thanks a lot for your clarification.
> >> >Yes as you said it is just a template, but it may
> >> >be quite confusing to new users while configuring.
> >> >I have raised the Issue
> >> ><https://issues.apache.org/jira/browse/HADOOP-8575>,
> >> >in case you might want to
> >> >have a look.Thanks
> >> >
> >> > Also I wanted to know is there a good source where I can
> >> >look upto for running a multi-node 2nd generation Hadoop ?
> >> >All I find is 1st generation Hadoop setup.
> >> >
> >> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]>
> >>wrote:
> >> >
> >> >> That may be something that we missed, as I have been providing my own
> >> >> marped-site.xml for quite a while now.  Have you tried it with
> >>branch-2
> >> >>or
> >> >> trunk to see if they are providing it?  In either case it is just
> >>going
> >> >>to
> >> >> be a template for you to fill in, but it would be nice to package
> >>that
> >> >> template for our users to follow.  If you want to file a JIRA for
> >>that
> >> >>it
> >> >> would be good, but I don't know how quickly we will be able to get
> >> >>around
> >> >> to doing it.
> >> >>
> >> >> --Bobby Evans
> >> >>
> >> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
> >> >>
> >> >> >Hi,
> >> >> >
> >> >> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes
> >>and
> >> >> >when I built the binary distribution and untar'd it .I don't see the
> >> >> >mapred-site.xml
> >> >> >file in the /etc/hadoop directory. But by the details given on how
> >>to
> >> >>run
> >> >> >the
> >> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
> >> >> >
> >> >> >  So I was just wondering if we are supposed to create the
> >> >>mapred-site.xml
> >> >> >, or
> >> >> >it doesn't exist at all? Thanks
> >> >> >
> >> >> >--
> >> >> >
> >> >> >--With Regards
> >> >> >Pavan Kulkarni
> >> >>
> >> >>
> >> >
> >> >
> >> >--
> >> >
> >> >--With Regards
> >> >Pavan Kulkarni
> >>
> >>
> >
> >
> >--
> >
> >--With Regards
> >Pavan Kulkarni
>
>
--

--With Regards
Pavan Kulkarni

I think so, or you have to have it set if your environment when you launch
the tasks.

On 7/9/12 3:27 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:

>Thanks a lot Robert. I also assume we need to set JAVA_HOME parameter in
>the hadoop-env.sh .
>I couldn't find this file as default just like mapred-site.xml.Am I
>correct?
>
>On Mon, Jul 9, 2012 at 12:36 PM, Robert Evans <[EMAIL PROTECTED]> wrote:
>
>> On 2.0 core-site, yarn-site, hdfs-site, and mapped-site are all kind of
>> needed.  The exact configs that you need to set may very a lot based off
>> of what you are trying to do.
>> --Bobby Evans
>>
>> On 7/6/12 6:58 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>>
>> >Hi Robert,
>> >
>> > Can you please share what all configuration files are mandatory for
>>the
>> >hadoop-0.23.3 to work.
>> >I am tuning a few but still not able to set it up completely.Thanks
>> >
>> >On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Sorry I don't know of a good source for that right now.  Perhaps
>>others
>> >>on
>> >> the list might know better then I do.
>> >>
>> >> On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>> >>
>> >> >Bobby,
>> >> >
>> >> >  Thanks a lot for your clarification.
>> >> >Yes as you said it is just a template, but it may
>> >> >be quite confusing to new users while configuring.
>> >> >I have raised the Issue
>> >> ><https://issues.apache.org/jira/browse/HADOOP-8575>,
>> >> >in case you might want to
>> >> >have a look.Thanks
>> >> >
>> >> > Also I wanted to know is there a good source where I can
>> >> >look upto for running a multi-node 2nd generation Hadoop ?
>> >> >All I find is 1st generation Hadoop setup.
>> >> >
>> >> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]>
>> >>wrote:
>> >> >
>> >> >> That may be something that we missed, as I have been providing my
>>own
>> >> >> marped-site.xml for quite a while now.  Have you tried it with
>> >>branch-2
>> >> >>or
>> >> >> trunk to see if they are providing it?  In either case it is just
>> >>going
>> >> >>to
>> >> >> be a template for you to fill in, but it would be nice to package
>> >>that
>> >> >> template for our users to follow.  If you want to file a JIRA for
>> >>that
>> >> >>it
>> >> >> would be good, but I don't know how quickly we will be able to get
>> >> >>around
>> >> >> to doing it.
>> >> >>
>> >> >> --Bobby Evans
>> >> >>
>> >> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]>
>>wrote:
>> >> >>
>> >> >> >Hi,
>> >> >> >
>> >> >> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes
>> >>and
>> >> >> >when I built the binary distribution and untar'd it .I don't see
>>the
>> >> >> >mapred-site.xml
>> >> >> >file in the /etc/hadoop directory. But by the details given on
>>how
>> >>to
>> >> >>run
>> >> >> >the
>> >> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
>> >> >> >
>> >> >> >  So I was just wondering if we are supposed to create the
>> >> >>mapred-site.xml
>> >> >> >, or
>> >> >> >it doesn't exist at all? Thanks
>> >> >> >
>> >> >> >--
>> >> >> >
>> >> >> >--With Regards
>> >> >> >Pavan Kulkarni
>> >> >>
>> >> >>
>> >> >
>> >> >
>> >> >--
>> >> >
>> >> >--With Regards
>> >> >Pavan Kulkarni
>> >>
>> >>
>> >
>> >
>> >--
>> >
>> >--With Regards
>> >Pavan Kulkarni
>>
>>
>
>
>--
>
>--With Regards
>Pavan Kulkarni