Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - processing multiple blocks by single JVM


Copy link to this message
-
processing multiple blocks by single JVM
Radim Kolar 2012-08-05, 21:53
In yarn, JVM does not exit after processing one HDFS block. If another
block is being processed by same JVM, it is called setup() again?

I discovered that my setup() method needs 15 seconds to execute.