Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - String replace functionality in Sqoop import using Oozie


Copy link to this message
-
RE: String replace functionality in Sqoop import using Oozie
Connell, Chuck 2013-02-04, 20:18
I mean to add a step, putting a Python piped script in the middle. So instead of

RDBMS --> Sqoop --> Hive

You would do

RDBMS --> some file format --> Python (replacing ctrl-a) --> modified files --> Sqoop --> Hive

Does that help?

Chuck
From: Nitin kak [mailto:[EMAIL PROTECTED]]
Sent: Monday, February 04, 2013 2:53 PM
To: [EMAIL PROTECTED]
Subject: Re: String replace functionality in Sqoop import using Oozie

Didn't get you. Could you please elaborate just a bit?
On Mon, Feb 4, 2013 at 2:43 PM, Connell, Chuck <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Do it first with Python??
From: Nitin kak [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Monday, February 04, 2013 2:42 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: String replace functionality in Sqoop import using Oozie

Hi guys,
     Is there a way to replace (or drop) a character in one of the fields on the fly while importing data from an RDBMS system? I basically want to replace Ctrl-A characters in the fields. I know its possible to do that with Sqoop Hive Import(--hive-delims-replacement) but Hive Sqoop import is know not to work correctly with Oozie(hope this one gets remedied soon).

Regards,
Nitin Kak