Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Hive mapper creation


+
Mohammad Tariq 2012-06-28, 18:47
Copy link to this message
-
Re: Hive mapper creation
Hi Mohammed

Internally In hive the processing is done using MapReduce. So like in mapreduce the splits are calculated on job submission and a mapper is assigned per split. So a mapper ideally process a split and not a row.

You can store data in various formats as text, sequence files, RC files etc. No restriction just on text files.
Regards
Bejoy KS

Sent from handheld, please excuse typos.

-----Original Message-----
From: Mohammad Tariq <[EMAIL PROTECTED]>
Date: Fri, 29 Jun 2012 00:17:05
To: user<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Hive mapper creation

Hello list,

         Since Hive tables are assumed to be of text input format, is
it right to assume that a mapper is created per row of a particular
table??Please correct me if my understanding is wrong. Also let me
know how mappers are created corresponding to a Hive query. Many
thanks.

Regards,
    Mohammad Tariq
+
Mohammad Tariq 2012-06-28, 18:59
+
Bejoy KS 2012-06-28, 19:07
+
Mohammad Tariq 2012-06-28, 19:25
+
Bejoy KS 2012-06-28, 19:29
+
Mohammad Tariq 2012-06-28, 19:35
+
Nitin Pawar 2012-06-28, 18:51