Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Monitor network traffic in hadoop


Copy link to this message
-
Re: Monitor network traffic in hadoop
hi, Abdul Navaz:
assign shuffle port in each NM using option "mapreduce.shuffle.port" in
mapred-site.xml,then
monitor this port use tcpdump or wireshark ,hope this info can help you

On Fri, Dec 6, 2013 at 11:22 AM, navaz <[EMAIL PROTECTED]> wrote:

> Hello
>
> I am following the tutorial hadoop on single node cluster and I am able
> test word count program  map reduce. its working fine.
>
> I would like to know
> How to monitor when shuffle phase network traffic occurs via wireshark or
> someother means.
>
> Pls guide me.
>
> Thanks
> Abdul Navaz
> Graduate student
> On Dec 5, 2013 6:56 PM, "navaz" <[EMAIL PROTECTED]> wrote:
>
>> Hello
>>
>> I am following the tutorial hadoop on single node cluster and I am able
>> test word count map reduce. its working fine.
>>
>> I would like to know
>> How to monitor when shuffle phase network traffic occurs via wireshark or
>> someother means.
>>
>> Pls guide me.
>>
>> Thanks
>> Abdul Navaz
>> Graduate student
>> University of Houston ,TX
>>
>