Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Query is taking long time to process and return the result


Copy link to this message
-
Query is taking long time to process and return the result
I am trying to run hive query on huge amount of data(almost in half of
petabyte), and these query running map reduce internally. it takes very
long time to generate the data set(map reduce to complete) what
optimization mechanism for hive and Hadoop i can use to make these query
faster, one more important question i have does the amount of disk
available for map reduce or in /tmp directory is important for faster map
reduce?

--

Shashwat Shriparv
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB