Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Rack Awareness


Copy link to this message
-
Re: Rack Awareness
Chris Embree 2013-03-26, 12:33
Make sure you have the topology script available on the JobTracker server
as well. This also requires a jobtracker stop/start to take effect.
Also, make sure $HADOOP_CONF resolves properly as the mapred user.

On Tue, Mar 26, 2013 at 1:19 AM, preethi ganeshan <
[EMAIL PROTECTED]> wrote:

> Hi,
>
> I tried refreshing nodes . I even restarted both job tracker and name node
> . It does not seem to change . I am using hadoop-1.0.3 . Does the version
> make a difference ??
>
> Thank you
>
> On Tue, Mar 26, 2013 at 10:38 AM, bharath vissapragada <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> Try running 'hadoop dfsadmin -refreshNodes' ! Your NN might have
>> cached previously set values!
>>
>> Thanks,
>>
>>
>> On Tue, Mar 26, 2013 at 10:31 AM, preethi ganeshan
>> <[EMAIL PROTECTED]> wrote:
>> > Hi,
>> >
>> > I used this script . In core-site.xml i have set
>> > net.topology.script.file.name to this file's path. Then i executed the
>> > script and passed my computers IP address. It returned /dc1/rack1 .
>> However
>> > , when i ran my MapReduce job it still says the job ran on default-rack
>> .
>> > How can i change that??
>> > Thank you
>> > Regards,
>> > Preethi Ganeshan
>> >
>> >
>> > ( I have made the changes accordingly to fit my computer )
>> >
>> > HADOOP_CONF=/etc/hadoop/conf
>> >
>> > while [ $# -gt 0 ] ; do
>> >   nodeArg=$1
>> >   exec< ${HADOOP_CONF}/topology.data
>> >   result=""
>> >   while read line ; do
>> >     ar=( $line )
>> >     if [ "${ar[0]}" = "$nodeArg" ] ; then
>> >       result="${ar[1]}"
>> >     fi
>> >   done
>> >   shift
>> >   if [ -z "$result" ] ; then
>> >     echo -n "/default/rack "
>> >   else
>> >     echo -n "$result "
>> >   fi
>> > done
>> >
>> > Topology data
>> >
>> > hadoopdata1.ec.com     /dc1/rack1
>> > hadoopdata1            /dc1/rack1
>> > 10.1.1.1               /dc1/rack2
>>
>
>