Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Multi-threaded map task


Copy link to this message
-
Multi-threaded map task
Hi, this is a simple question, but why wasn't map or reduce tasks
programmed to be multi-threaded ? ie. instead of spawning 6 map tasks for 6
cores, run one map task with 6 parallel threads.

In fact I tried this myself, but turns that threading is not helping as it
would be in regular java programs for some reason .. any feedback on this
topic?

Thanks,
Mark
+
Nitin Pawar 2013-01-14, 06:34
+
Mark Olimpiati 2013-01-14, 07:22
+
Bertrand Dechoux 2013-01-14, 08:06
+
Mark Olimpiati 2013-01-14, 20:23
+
Mark Olimpiati 2013-01-14, 20:44
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB