Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # dev - No mapred-site.xml in the hadoop-0.23.3 distribution


+
Pavan Kulkarni 2012-07-06, 00:23
+
Robert Evans 2012-07-06, 14:13
+
Pavan Kulkarni 2012-07-06, 17:05
+
Robert Evans 2012-07-06, 17:24
+
Pavan Kulkarni 2012-07-06, 23:58
+
Robert Evans 2012-07-09, 19:36
+
Pavan Kulkarni 2012-07-09, 20:27
Copy link to this message
-
Re: No mapred-site.xml in the hadoop-0.23.3 distribution
Robert Evans 2012-07-09, 21:10
I think so, or you have to have it set if your environment when you launch
the tasks.

On 7/9/12 3:27 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:

>Thanks a lot Robert. I also assume we need to set JAVA_HOME parameter in
>the hadoop-env.sh .
>I couldn't find this file as default just like mapred-site.xml.Am I
>correct?
>
>On Mon, Jul 9, 2012 at 12:36 PM, Robert Evans <[EMAIL PROTECTED]> wrote:
>
>> On 2.0 core-site, yarn-site, hdfs-site, and mapped-site are all kind of
>> needed.  The exact configs that you need to set may very a lot based off
>> of what you are trying to do.
>> --Bobby Evans
>>
>> On 7/6/12 6:58 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>>
>> >Hi Robert,
>> >
>> > Can you please share what all configuration files are mandatory for
>>the
>> >hadoop-0.23.3 to work.
>> >I am tuning a few but still not able to set it up completely.Thanks
>> >
>> >On Fri, Jul 6, 2012 at 10:24 AM, Robert Evans <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Sorry I don't know of a good source for that right now.  Perhaps
>>others
>> >>on
>> >> the list might know better then I do.
>> >>
>> >> On 7/6/12 12:05 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]> wrote:
>> >>
>> >> >Bobby,
>> >> >
>> >> >  Thanks a lot for your clarification.
>> >> >Yes as you said it is just a template, but it may
>> >> >be quite confusing to new users while configuring.
>> >> >I have raised the Issue
>> >> ><https://issues.apache.org/jira/browse/HADOOP-8575>,
>> >> >in case you might want to
>> >> >have a look.Thanks
>> >> >
>> >> > Also I wanted to know is there a good source where I can
>> >> >look upto for running a multi-node 2nd generation Hadoop ?
>> >> >All I find is 1st generation Hadoop setup.
>> >> >
>> >> >On Fri, Jul 6, 2012 at 7:13 AM, Robert Evans <[EMAIL PROTECTED]>
>> >>wrote:
>> >> >
>> >> >> That may be something that we missed, as I have been providing my
>>own
>> >> >> marped-site.xml for quite a while now.  Have you tried it with
>> >>branch-2
>> >> >>or
>> >> >> trunk to see if they are providing it?  In either case it is just
>> >>going
>> >> >>to
>> >> >> be a template for you to fill in, but it would be nice to package
>> >>that
>> >> >> template for our users to follow.  If you want to file a JIRA for
>> >>that
>> >> >>it
>> >> >> would be good, but I don't know how quickly we will be able to get
>> >> >>around
>> >> >> to doing it.
>> >> >>
>> >> >> --Bobby Evans
>> >> >>
>> >> >> On 7/5/12 7:23 PM, "Pavan Kulkarni" <[EMAIL PROTECTED]>
>>wrote:
>> >> >>
>> >> >> >Hi,
>> >> >> >
>> >> >> >  I downloaded the Hadoop-0.23.3 source and tweaked a few classes
>> >>and
>> >> >> >when I built the binary distribution and untar'd it .I don't see
>>the
>> >> >> >mapred-site.xml
>> >> >> >file in the /etc/hadoop directory. But by the details given on
>>how
>> >>to
>> >> >>run
>> >> >> >the
>> >> >> >Hadoop-0.23.3 the mapred-site.xml needs to be configured right?
>> >> >> >
>> >> >> >  So I was just wondering if we are supposed to create the
>> >> >>mapred-site.xml
>> >> >> >, or
>> >> >> >it doesn't exist at all? Thanks
>> >> >> >
>> >> >> >--
>> >> >> >
>> >> >> >--With Regards
>> >> >> >Pavan Kulkarni
>> >> >>
>> >> >>
>> >> >
>> >> >
>> >> >--
>> >> >
>> >> >--With Regards
>> >> >Pavan Kulkarni
>> >>
>> >>
>> >
>> >
>> >--
>> >
>> >--With Regards
>> >Pavan Kulkarni
>>
>>
>
>
>--
>
>--With Regards
>Pavan Kulkarni