Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Understand dfs.datanode.max.xcievers

Copy link to this message
Understand dfs.datanode.max.xcievers
Dhanasekaran Anbalagan 2013-03-17, 13:12
Hi Guys,

We are having few data nodes in an inconsistent state.  frequently goes
dead state. Because of DataXceiver Error

In console we seen the Error.
*INFO hdfs.DFSClient: Could not obtain block*
blk_XXXXXXXXXXXXXXXXXXXXXX_YYYYYYYY from any node: java.io.IOException:

currently we have this value.
dfs.datanode.max.xcievers, dfs.datanode.max.transfer.threads = 4096

currently monitering our cluster JVM monitoring using openNMS,

Not at all hit 4096 value this value for this week . But frequently
the particular node goes dead state why? log says DataXceiver Error.
 dfs.datanode.max.xcievers value set to the particular node or across the
cluster Please guide me.

Did I learn something today? If not, I wasted it.
Yanbo Liang 2013-03-18, 10:23