Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> sqoop report on invalid rows


Copy link to this message
-
Re: sqoop report on invalid rows
Hi Thuy,
Sqoop currently requires you to have clean data set without any corruptions. I think that you can run custom mapreduce/pig job to clean the data up prior exporting them with Sqoop.

Jarcec

On Tue, Apr 30, 2013 at 09:35:59PM -0700, Thuy Nguyen wrote:
> Hi all,
>
> I would like to export some data from hdfs to mysql, and certain values are
> not in the format expected by mysql type, e.g. '1234 ' instead of '1234',
> then sqoop will fail.
>
> Is there a way to export valid data rows into a table, and report on
> invalid data/rows?
>
> Thanks,
> Thuy
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB