Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Sqoop import Format Issue

Copy link to this message
Re: Sqoop import Format Issue
Vineet Mishra 2013-01-21, 11:20
Hallo All,

I am working with Sqoop for writing data back to Database from HDFS, I am
currently stuck in an issue, the scenerio is like,

I have a Postgres database with a table TestSqoop consisting of three
*id integer SERIAL, volume numeric(8,2), zip integer*
where id is the autoincrement field, I am having a data file in HDFS where
I want to insert only last two rows(except id which is already auto
incremented) so if my data file contains the data in this format


where I am specifying the value even for the id which I don't want as it
should be auto incremented.
Kindly let me know if there is a way round so that I can neglect the id
attribute value in my data file so that it should auto increment in
On Fri, Jan 18, 2013 at 4:50 PM, Vineet Mishra

> Hallo All,
> I am working with Sqoop to query from the database to for my Map/Reduce
> job, the issue I am struggling with is
> 1) Is there a way to directly pass the Sqoop Import Result to the Map for
> processing rather than storing it to file system and then processing.
> If above can't be done then let me know whether,
> 2) I want the format of the file which is coming from the sqoop import
> command  to be comma(,) separated single line file, but my output is coming
> as a multi row file.
> I am querying from the Database fetching a single column of some random
> values, which is coming in the format,
> 1234
> 1235
> 1564
> 1674
> 1546
> 2546
> 5653
> 6434
> the output which I was expecting was,
> 1234,1235,1564,1674,1546,2546,5653,6434
> and so on. . .
> Urgent!!!
> Sqoop Developers/Users please reply!
> --
> Thanks and Regards
> Vineet Mishra

Thanks and Regards
Vineet Mishra