Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: access to hadoop cluster to post tasks remotely


Copy link to this message
-
Re: access to hadoop cluster to post tasks remotely
Roman Shaposhnik 2013-11-06, 23:59
On Wed, Nov 6, 2013 at 3:55 PM, Sergey Gerasimov
<[EMAIL PROTECTED]> wrote:
> But I still don’t understand why hadoop engine tries  to connect to
> DataNodes from client(!) machine during posting jar from client machine to
> the cluster.

Only metadata traffic goes to the NN, once metadata operations resolve
the block locations after that direct streaming to the DNs begins.

Thanks,
Roman.