Hi All,

I am an experienced Informatica and Java Developer. I am very new to Hadoop. I have one basic question for the group. Please advise.

Can we do ETL (Example: load data from an oracle table to another oracle table) using Hadoop? If so, how can we implement that.

>From my understanding, I see that Hive is for reporting purposes and not for ETL. Let me know if this is right.

Regards,
Rajendra

Hi Rajendra,

We use Hive for a large data warehouse, details here:
http://wiki.apache.org/hadoop/Hive

thanks,
dhruba
On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am an experienced Informatica and Java Developer. I am very new to
> Hadoop. I have one basic question for the group. Please advise.
>
> Can we do ETL (Example: load data from an oracle table to another oracle
> table) using Hadoop? If so, how can we implement that.
>
> From my understanding, I see that Hive is for reporting purposes and not
> for ETL. Let me know if this is right.
>
> Regards,
> Rajendra
>
>
--
Connect to me at http://www.facebook.com/dhruba

Hey Rajendra,

For the "E" part of your task, you may want to check out Sqoop:
http://www.cloudera.com/hadoop-sqoop.

Regards,
Jeff

On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <[EMAIL PROTECTED]> wrote:

> Hi Rajendra,
>
> We use Hive for a large data warehouse, details here:
> http://wiki.apache.org/hadoop/Hive
>
> thanks,
> dhruba
>
>
> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> [EMAIL PROTECTED]> wrote:
>
> > Hi All,
> >
> > I am an experienced Informatica and Java Developer. I am very new to
> > Hadoop. I have one basic question for the group. Please advise.
> >
> > Can we do ETL (Example: load data from an oracle table to another oracle
> > table) using Hadoop? If so, how can we implement that.
> >
> > From my understanding, I see that Hive is for reporting purposes and not
> > for ETL. Let me know if this is right.
> >
> > Regards,
> > Rajendra
> >
> >
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>

Jeff, This is great info. Thanks
-----Original Message-----
From: Jeff Hammerbacher [mailto:[EMAIL PROTECTED]]
Sent: Thursday, November 12, 2009 4:16 PM
To: [EMAIL PROTECTED]
Subject: Re: ETL using Hadoop ???

Hey Rajendra,

For the "E" part of your task, you may want to check out Sqoop:
http://www.cloudera.com/hadoop-sqoop.

Regards,
Jeff

On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <[EMAIL PROTECTED]> wrote:

> Hi Rajendra,
>
> We use Hive for a large data warehouse, details here:
> http://wiki.apache.org/hadoop/Hive
>
> thanks,
> dhruba
>
>
> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> [EMAIL PROTECTED]> wrote:
>
> > Hi All,
> >
> > I am an experienced Informatica and Java Developer. I am very new to
> > Hadoop. I have one basic question for the group. Please advise.
> >
> > Can we do ETL (Example: load data from an oracle table to another oracle
> > table) using Hadoop? If so, how can we implement that.
> >
> > From my understanding, I see that Hive is for reporting purposes and not
> > for ETL. Let me know if this is right.
> >
> > Regards,
> > Rajendra
> >
> >
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>

Does sqoop also allow you to export data from hadoop to a db?  I
didn't see that in the documentation

-Steve

On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote:
> Hey Rajendra,
>
> For the "E" part of your task, you may want to check out Sqoop:
> http://www.cloudera.com/hadoop-sqoop.
>
> Regards,
> Jeff
>
> On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <[EMAIL PROTECTED]> wrote:
>
>> Hi Rajendra,
>>
>> We use Hive for a large data warehouse, details here:
>> http://wiki.apache.org/hadoop/Hive
>>
>> thanks,
>> dhruba
>>
>>
>> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
>> [EMAIL PROTECTED]> wrote:
>>
>> > Hi All,
>> >
>> > I am an experienced Informatica and Java Developer. I am very new to
>> > Hadoop. I have one basic question for the group. Please advise.
>> >
>> > Can we do ETL (Example: load data from an oracle table to another oracle
>> > table) using Hadoop? If so, how can we implement that.
>> >
>> > From my understanding, I see that Hive is for reporting purposes and not
>> > for ETL. Let me know if this is right.
>> >
>> > Regards,
>> > Rajendra
>> >
>> >
>>
>>
>> --
>> Connect to me at http://www.facebook.com/dhruba
>>
>

Hey Steve,

See https://issues.apache.org/jira/browse/MAPREDUCE-1168.

Regards,
Jeff

On Thu, Nov 12, 2009 at 1:35 PM, Steve Morin <[EMAIL PROTECTED]> wrote:

> Does sqoop also allow you to export data from hadoop to a db?  I
> didn't see that in the documentation
>
> -Steve
>
> On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <[EMAIL PROTECTED]>
> wrote:
> > Hey Rajendra,
> >
> > For the "E" part of your task, you may want to check out Sqoop:
> > http://www.cloudera.com/hadoop-sqoop.
> >
> > Regards,
> > Jeff
> >
> > On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <[EMAIL PROTECTED]>
> wrote:
> >
> >> Hi Rajendra,
> >>
> >> We use Hive for a large data warehouse, details here:
> >> http://wiki.apache.org/hadoop/Hive
> >>
> >> thanks,
> >> dhruba
> >>
> >>
> >> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >> > Hi All,
> >> >
> >> > I am an experienced Informatica and Java Developer. I am very new to
> >> > Hadoop. I have one basic question for the group. Please advise.
> >> >
> >> > Can we do ETL (Example: load data from an oracle table to another
> oracle
> >> > table) using Hadoop? If so, how can we implement that.
> >> >
> >> > From my understanding, I see that Hive is for reporting purposes and
> not
> >> > for ETL. Let me know if this is right.
> >> >
> >> > Regards,
> >> > Rajendra
> >> >
> >> >
> >>
> >>
> >> --
> >> Connect to me at http://www.facebook.com/dhruba
> >>
> >
>

Thanks
Jeff

On Thu, Nov 12, 2009 at 1:36 PM, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote:
> Hey Steve,
>
> See https://issues.apache.org/jira/browse/MAPREDUCE-1168.
>
> Regards,
> Jeff
>
> On Thu, Nov 12, 2009 at 1:35 PM, Steve Morin <[EMAIL PROTECTED]> wrote:
>
>> Does sqoop also allow you to export data from hadoop to a db?  I
>> didn't see that in the documentation
>>
>> -Steve
>>
>> On Thu, Nov 12, 2009 at 1:16 PM, Jeff Hammerbacher <[EMAIL PROTECTED]>
>> wrote:
>> > Hey Rajendra,
>> >
>> > For the "E" part of your task, you may want to check out Sqoop:
>> > http://www.cloudera.com/hadoop-sqoop.
>> >
>> > Regards,
>> > Jeff
>> >
>> > On Thu, Nov 12, 2009 at 10:02 AM, Dhruba Borthakur <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Hi Rajendra,
>> >>
>> >> We use Hive for a large data warehouse, details here:
>> >> http://wiki.apache.org/hadoop/Hive
>> >>
>> >> thanks,
>> >> dhruba
>> >>
>> >>
>> >> On Thu, Nov 12, 2009 at 9:55 AM, Palikala, Rajendra (CCL) <
>> >> [EMAIL PROTECTED]> wrote:
>> >>
>> >> > Hi All,
>> >> >
>> >> > I am an experienced Informatica and Java Developer. I am very new to
>> >> > Hadoop. I have one basic question for the group. Please advise.
>> >> >
>> >> > Can we do ETL (Example: load data from an oracle table to another
>> oracle
>> >> > table) using Hadoop? If so, how can we implement that.
>> >> >
>> >> > From my understanding, I see that Hive is for reporting purposes and
>> not
>> >> > for ETL. Let me know if this is right.
>> >> >
>> >> > Regards,
>> >> > Rajendra
>> >> >
>> >> >
>> >>
>> >>
>> >> --
>> >> Connect to me at http://www.facebook.com/dhruba
>> >>
>> >
>>
>