Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Sqoop import Format Issue


+
Vineet Mishra 2013-01-18, 11:20
+
Vineet Mishra 2013-01-21, 11:20
Copy link to this message
-
Re: Sqoop import Format Issue
Hi Vineet,
I'm afraid that Sqoop is currently not supporting such use case.

Jarcec

On Mon, Jan 21, 2013 at 04:50:54PM +0530, Vineet Mishra wrote:
> Hallo All,
>
> I am working with Sqoop for writing data back to Database from HDFS, I am
> currently stuck in an issue, the scenerio is like,
>
> I have a Postgres database with a table TestSqoop consisting of three
> fields,
> *id integer SERIAL, volume numeric(8,2), zip integer*
>
>
> where id is the autoincrement field, I am having a data file in HDFS where
> I want to insert only last two rows(except id which is already auto
> incremented) so if my data file contains the data in this format
>
> 1,28.00,10005
> 2,403.71,90210
> 3,20.02,95014
>
> where I am specifying the value even for the id which I don't want as it
> should be auto incremented.
> Kindly let me know if there is a way round so that I can neglect the id
> attribute value in my data file so that it should auto increment in
> Database.
>
>
> Urgent!!!
>
>
> On Fri, Jan 18, 2013 at 4:50 PM, Vineet Mishra
> <[EMAIL PROTECTED]>wrote:
>
> > Hallo All,
> >
> > I am working with Sqoop to query from the database to for my Map/Reduce
> > job, the issue I am struggling with is
> >
> > 1) Is there a way to directly pass the Sqoop Import Result to the Map for
> > processing rather than storing it to file system and then processing.
> >
> > If above can't be done then let me know whether,
> >
> > 2) I want the format of the file which is coming from the sqoop import
> > command  to be comma(,) separated single line file, but my output is coming
> > as a multi row file.
> >
> >
> > I am querying from the Database fetching a single column of some random
> > values, which is coming in the format,
> >
> > 1234
> > 1235
> > 1564
> > 1674
> > 1546
> > 2546
> > 5653
> > 6434
> >
> > the output which I was expecting was,
> >
> > 1234,1235,1564,1674,1546,2546,5653,6434
> >
> > and so on. . .
> >
> > Urgent!!!
> > Sqoop Developers/Users please reply!
> >
> >
> > --
> > Thanks and Regards
> > Vineet Mishra
> >
>
>
>
> --
> Thanks and Regards
> Vineet Mishra
+
Vineet Mishra 2013-01-21, 07:31
+
abhijeet gaikwad 2013-01-21, 08:38
+
Vineet Mishra 2013-01-21, 08:43
+
abhijeet gaikwad 2013-01-21, 11:53
+
Vineet Mishra 2013-01-21, 12:01
+
Vineet Mishra 2013-01-18, 12:31
+
abhijeet gaikwad 2013-01-18, 12:41
+
abhijeet gaikwad 2013-01-18, 11:50
+
Vineet Mishra 2013-01-18, 12:06
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB