Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> How to simulate network delay on 1 node


Copy link to this message
-
Re: How to simulate network delay on 1 node
If you're studying how the hadoop make the copies of the blocks, I'm not
familiar with HDFS, so I have no idea about it

If you're studying the data transfer between the Map and Reduce, I think
org.apache.hadoop.mapred.TaskTracker.MapOutputServlet is helpful

Bests
Nan

On Sun, Dec 26, 2010 at 8:56 PM, yipeng <[EMAIL PROTECTED]> wrote:

> I'm trying to explore how Hadoop performs certain tasks (data deduplication
> actually)  under such conditions.
>
> Cheers,
>
> Yipeng
>
>
> On Sun, Dec 26, 2010 at 8:31 PM, Nan Zhu <[EMAIL PROTECTED]> wrote:
>
> > Why would you like to *simulate* network delay? I haven't got your point,
> >
> > Bests,
> > Nan
> >
> >
> >
> > On Sun, Dec 26, 2010 at 8:25 PM, yipeng <[EMAIL PROTECTED]> wrote:
> >
> > > Hi everyone,
> > >
> > > I would like to simulate network delay on 1 node in my cluster, perhaps
> > by
> > > putting the thread to sleep every time it transfers data non-locally.
> I'm
> > > looking at the source but am not sure where to place the code. Is there
> a
> > > better way to do it... a tool perhaps? Or could someone point me in the
> > > right direction?
> > >
> > > Cheers,
> > >
> > > Yipeng
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB