Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Monitor network traffic in hadoop


Copy link to this message
-
Re: Monitor network traffic in hadoop
hi, Abdul Navaz:
assign shuffle port in each NM using option "mapreduce.shuffle.port" in
mapred-site.xml,then
monitor this port use tcpdump or wireshark ,hope this info can help you

On Fri, Dec 6, 2013 at 11:22 AM, navaz <[EMAIL PROTECTED]> wrote:

> Hello
>
> I am following the tutorial hadoop on single node cluster and I am able
> test word count program  map reduce. its working fine.
>
> I would like to know
> How to monitor when shuffle phase network traffic occurs via wireshark or
> someother means.
>
> Pls guide me.
>
> Thanks
> Abdul Navaz
> Graduate student
> On Dec 5, 2013 6:56 PM, "navaz" <[EMAIL PROTECTED]> wrote:
>
>> Hello
>>
>> I am following the tutorial hadoop on single node cluster and I am able
>> test word count map reduce. its working fine.
>>
>> I would like to know
>> How to monitor when shuffle phase network traffic occurs via wireshark or
>> someother means.
>>
>> Pls guide me.
>>
>> Thanks
>> Abdul Navaz
>> Graduate student
>> University of Houston ,TX
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB