Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Hive job not distributing


Copy link to this message
-
Hive job not distributing
I have a job that has lots of tiny map tasks that finish very fast (I think
my max time was 9 seconds) I understand that I should change my input to
avoid that... and it's difficult because these processes are using a
transform script on binary data so it makes it difficult to pull off (Long
story). That being said, the cluster isn't distributing the job. Only one
node is running the map tasks. They are finishing quickly, but I am just
wondering would cause that ... I know the job tracker and task trackers on
other nodes are running, it's just odd.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB