Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> sqoop report on invalid rows

Copy link to this message
Re: sqoop report on invalid rows
Hi Thuy,
Sqoop currently requires you to have clean data set without any corruptions. I think that you can run custom mapreduce/pig job to clean the data up prior exporting them with Sqoop.


On Tue, Apr 30, 2013 at 09:35:59PM -0700, Thuy Nguyen wrote:
> Hi all,
> I would like to export some data from hdfs to mysql, and certain values are
> not in the format expected by mysql type, e.g. '1234 ' instead of '1234',
> then sqoop will fail.
> Is there a way to export valid data rows into a table, and report on
> invalid data/rows?
> Thanks,
> Thuy