Hey Team,

We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table.
Please help

*------------------------*

Cheers !!!

Siddharth Tiwari

Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God.”

"Maybe other people will try to limit me but I don't limit myself"
     

Sqoop is a nice tool to get dAta to/from DB2 to hive and then you can run hive queries on top of it.

Lot of people are using this for traditional DBs and hadoop connectivity.

Sent from my iPhone

On Jul 26, 2012, at 11:32 AM, Siddharth Tiwari <[EMAIL PROTECTED]> wrote:

> Hey Team,
>
> We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table.
> Please help
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of God.”
> "Maybe other people will try to limit me but I don't limit myself"

Can you export from DB2 to a plain text tab-separated file? You can certainly import that to Hive.

Chuck Connell
Nuance R&D Data Team
Burlington, MA
From: Siddharth Tiwari [mailto:[EMAIL PROTECTED]]
Sent: Thursday, July 26, 2012 2:33 PM
To: hive user list
Subject: Creating Hive table by pulling data from mainFrames

Hey Team,

We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table.
Please help
*------------------------*
Cheers !!!
Siddharth Tiwari
Have a refreshing day !!!
"Every duty is holy, and devotion to duty is the highest form of worship of God."
"Maybe other people will try to limit me but I don't limit myself"

try looking out at sqoop .. meant to transfer data from rdbms systems to hive

not sure it works with DB2 or not

On Fri, Jul 27, 2012 at 12:02 AM, Siddharth Tiwari
<[EMAIL PROTECTED]> wrote:
> Hey Team,
>
> We have huge tables in Mainframe DB2. Can some one tell if its possible to
> pull data from DB2 in Mainframe to hive and then use MapReduce to sort the
> data in hive and push it back to Mainframe table.
> Please help
>
>
> *------------------------*
> Cheers !!!
> Siddharth Tiwari
> Have a refreshing day !!!
> "Every duty is holy, and devotion to duty is the highest form of worship of
> God.”
> "Maybe other people will try to limit me but I don't limit myself"

--
Nitin Pawar

<font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"> Yes<br>We have implemented a solution where we pulled data from DB2 using sqoop. There is certain problem we faced while doing this exercise which we overcame. I think the solution was a specific DB2 jdbc jar and creating a connection pool or something i can't recollect.<br><br><br>Debarshi Basak<br>Tata Consultancy Services<br>Mailto: [EMAIL PROTECTED]<br>Website: http://www.tcs.com<br>____________________________________________<br>Experience certainty. IT Services<br> Business Solutions<br> Outsourcing<br>____________________________________________<br><br><font color="#990099">-----Nitin Pawar <[EMAIL PROTECTED]> wrote: -----</[EMAIL PROTECTED]></font><div><blockquote style="padding-right: 0px; padding-left: 5px; margin-left: 5px; border-left: 2px solid black; margin-right: 0px;">To: [EMAIL PROTECTED]<br>From: Nitin Pawar <[EMAIL PROTECTED]><br>Date: 07/27/2012 12:09AM<br>Subject: Re: Creating Hive table by pulling data from mainFrames<br><br><pre>try looking out at sqoop .. meant to transfer data from rdbms systems to hive<br><br>not sure it works with DB2 or not<br><br>On Fri, Jul 27, 2012 at 12:02 AM, Siddharth Tiwari<br><[EMAIL PROTECTED]> wrote:<br>> Hey Team,<br>><br>> We have huge tables in Mainframe DB2. Can some one tell if its possible to<br>> pull data from DB2 in Mainframe to hive and then use MapReduce to sort the<br>> data in hive and push it back to Mainframe table.<br>> Please help<br>><br>><br>> *------------------------*<br>> Cheers !!!<br>> Siddharth Tiwari<br>> Have a refreshing day !!!<br>> "Every duty is holy, and devotion to duty is the highest form of worship of<br>> God.”<br>> "Maybe other people will try to limit me but I don't limit myself"<br><br><br><br>-- <br>Nitin Pawar<br></pre></blockquote></div><div></div></font><p>=====-----=====-----=====<br>
Notice: The information contained in this e-mail<br>
message and/or attachments to it may contain <br>
confidential or privileged information. If you are <br>
not the intended recipient, any dissemination, use, <br>
review, distribution, printing or copying of the <br>
information contained in this e-mail message <br>
and/or attachments to it are strictly prohibited. If <br>
you have received this communication in error, <br>
please notify us by reply e-mail or telephone and <br>
immediately and permanently delete the message <br>
and any attachments. Thank you</p>

<p></p>