Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop import Format Issue


Copy link to this message
-
Re: Sqoop import Format Issue
Hi Vineet,
I'm afraid that Sqoop is currently not supporting such use case.

Jarcec

On Mon, Jan 21, 2013 at 04:50:54PM +0530, Vineet Mishra wrote:
> Hallo All,
>
> I am working with Sqoop for writing data back to Database from HDFS, I am
> currently stuck in an issue, the scenerio is like,
>
> I have a Postgres database with a table TestSqoop consisting of three
> fields,
> *id integer SERIAL, volume numeric(8,2), zip integer*
>
>
> where id is the autoincrement field, I am having a data file in HDFS where
> I want to insert only last two rows(except id which is already auto
> incremented) so if my data file contains the data in this format
>
> 1,28.00,10005
> 2,403.71,90210
> 3,20.02,95014
>
> where I am specifying the value even for the id which I don't want as it
> should be auto incremented.
> Kindly let me know if there is a way round so that I can neglect the id
> attribute value in my data file so that it should auto increment in
> Database.
>
>
> Urgent!!!
>
>
> On Fri, Jan 18, 2013 at 4:50 PM, Vineet Mishra
> <[EMAIL PROTECTED]>wrote:
>
> > Hallo All,
> >
> > I am working with Sqoop to query from the database to for my Map/Reduce
> > job, the issue I am struggling with is
> >
> > 1) Is there a way to directly pass the Sqoop Import Result to the Map for
> > processing rather than storing it to file system and then processing.
> >
> > If above can't be done then let me know whether,
> >
> > 2) I want the format of the file which is coming from the sqoop import
> > command  to be comma(,) separated single line file, but my output is coming
> > as a multi row file.
> >
> >
> > I am querying from the Database fetching a single column of some random
> > values, which is coming in the format,
> >
> > 1234
> > 1235
> > 1564
> > 1674
> > 1546
> > 2546
> > 5653
> > 6434
> >
> > the output which I was expecting was,
> >
> > 1234,1235,1564,1674,1546,2546,5653,6434
> >
> > and so on. . .
> >
> > Urgent!!!
> > Sqoop Developers/Users please reply!
> >
> >
> > --
> > Thanks and Regards
> > Vineet Mishra
> >
>
>
>
> --
> Thanks and Regards
> Vineet Mishra