Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Hive mapper creation


+
Mohammad Tariq 2012-06-28, 18:47
Copy link to this message
-
Re: Hive mapper creation
Hi Mohammed

Internally In hive the processing is done using MapReduce. So like in mapreduce the splits are calculated on job submission and a mapper is assigned per split. So a mapper ideally process a split and not a row.

You can store data in various formats as text, sequence files, RC files etc. No restriction just on text files.
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Mohammad Tariq <[EMAIL PROTECTED]>
Date: Fri, 29 Jun 2012 00:17:05
To: user<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Hive mapper creation

Hello list,

         Since Hive tables are assumed to be of text input format, is
it right to assume that a mapper is created per row of a particular
table??Please correct me if my understanding is wrong. Also let me
know how mappers are created corresponding to a Hive query. Many
thanks.

Regards,
    Mohammad Tariq
+
Mohammad Tariq 2012-06-28, 18:59
+
Bejoy KS 2012-06-28, 19:07
+
Mohammad Tariq 2012-06-28, 19:25
+
Bejoy KS 2012-06-28, 19:29
+
Mohammad Tariq 2012-06-28, 19:35
+
Nitin Pawar 2012-06-28, 18:51
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB