Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Fwd: Incremental Import for Sqoop2


Copy link to this message
-
Re: Fwd: Incremental Import for Sqoop2
vasanth kumar 2013-05-14, 18:32
Hi,
Try using Boundary query or sql statement while creating import job for
filtering records.

For example: Importing id greater than 100
Boundary query: select min(id),max(id) from table where id>100

Sorry if I am wrong.
On Tue, May 14, 2013 at 11:06 PM, Joanne Chan <[EMAIL PROTECTED]>wrote:

> Hi Jarek,
>
> Thanks for the speedy response!
>
> Any idea what the timeline is for this feature?
>
> I am trying to utilize sqoop2 to pull new/updated data from mysql to hdfs.
>
> Do you know of any workarounds for sqoop2 to get this job done without
> having to use incremental import?
>
> Appreciate your input!
>
>
> On Tue, May 14, 2013 at 1:23 PM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:
>
>> Hi sir,
>> Sqoop 2 currently can't do incremental imports, however implementing this
>> feature is definitely in our plan!
>>
>> Jarcec
>>
>> On Tue, May 14, 2013 at 01:14:32PM -0400, Joanne Chan wrote:
>> > Is incremental import available for sqoop2?  If not, is that part of the
>> > plan?
>> >
>> > I can't seem to find any good example of how to create import job with
>> > incremental parameter.
>> >
>> > I am on:
>> > client version:
>> >   Sqoop 2.0.0-SNAPSHOT revision c0a43d436fdd9293bf10e4b874d1002441c056b1
>> > server version:
>> >   Sqoop 2.0.0-SNAPSHOT revision c0a43d436fdd9293bf10e4b874d1002441c056b1
>>
>
>
>
> --
> -- JChan
>
>
--
Regards
Vasanth kumar RJ