Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop exporting error


Copy link to this message
-
Re: Sqoop exporting error
Jarcec
Please find below the versions
sqoop: sqoop-1.4.2.bin__hadoop-1.0.0.tar.gz
jdbc: postgresql-9.2-1000.jdbc4.jar
postgresql: PostgreSQL 9.1.3 on x86_64-unknown-linux-gnu, compiled by
gcc-4.4.real (Ubuntu 4.4.3-4ubuntu5.1) 4.4.3, 64-bit
hadoop: Hadoop 1.0.3 (Amazon Distribution)
Cheers
Matthieu

On Tue, Nov 6, 2012 at 2:33 PM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:

> Hi Matthieu,
> thank you very much for your outputs. I've took a look and I'm really not
> sure what is wrong. It seems that from strange reason sqoop submits for ts
> column value '[B@ba6c13' that seems to me an object address. But code
> that you've sent is correctly serializing long, so I'm really not sure what
> might be an issue here.
>
> What versions are you using? (Sqoop, Hadoop, Postgre SQL JDBC Driver)?
>
> Jarcec
>
> On Tue, Nov 06, 2012 at 01:17:00PM -0500, Matthieu Labour wrote:
> > Hi Jarcec
> >
> > I apologize for not getting back sooner to you. I live in NYC and life
> has
> > been hectic here with the hurricane. Thank you for taking the time to
> look
> > in my issue. Please find below the information requested.
> >
> >
> > 1. Here is the command being executed followed by the error produced.
> >  Attached is ml_ys_log_gmt_test.java
> >
> > ~/$SQOOP_ROOT/bin/sqoop export --connect jdbc:postgresql://
> > ec2-XX-XX-XXX-XX.compute-1.amazonaws.com:5662/dfg2tulf7263ut --username
> > ufjb0gfs1n5kut --password xxxxxxxxx  --table ml_ys_log_gmt_test
> > --export-dir $HADOOP_INPUT/$LOGS_HOME/dt=$(date +%Y-%m-%d)
> > --input-fields-terminated-by='\t' --lines-terminated-by='\n' --verbose
> > --batch
> >
> > 12/11/06 17:35:33 INFO mapred.JobClient: Task Id :
> > attempt_201211061658_0014_m_000000_0, Status : FAILED
> > java.io.IOException: java.sql.BatchUpdateException: Batch entry 71 INSERT
> > INTO ml_ys_log_gmt_test (date, ts, environment, resource, network,
> > advertiser, campaign, creative, cost, click, flavor, ui_element_id,
> > ui_element_type, event, charge_id, charge_type, charge_vertical,
> > charge_payer, charge_amount, model, imageformatsupport, inputmodesupport,
> > scriptsupport, vendor, stylesheetsupport, markupsupport, displaywidth,
> > cookiesupport, displayheight, version, inputdevices, displaycolordepth,
> > device_os, device_os_version, mobile_browser, mobile_browser_version,
> > is_tablet, dual_orientation, marketing_name) VALUES ('2012-10-31
> > 20:42:56.767000 +00:00:00', '[B@ba6c13',
> >
> 'remote-addr=10.84.101.45&user-agent=LG-CT810%2FV10x+NetFront%2Fv3.5+Profile%2FMIDP-2.0+Configuration%2FCLDC-1.1',
> > 'hxCA', 'MLNL', '1006', '10014', '1410', NULL, 'mdkP', '10014', '', '',
> > 'click', '', '', '', '', NULL, 'CT810', '', '', '', 'LG', '', '', '400',
> > '', '240', '', 'stylus', '', 'Windows Mobile OS', '6.1', 'Microsoft
> Mobile
> > Explorer', '7.11', 'false', 'false', '') was aborted.  Call
> > getNextException to see the cause.
> >         at
> >
> org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)
> >         at
> >
> org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:46)
> >         at
> >
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:646)
> >         at
> >
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> >         at
> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:78)
> >         at
> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:36)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> >
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:182)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:771)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:375)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
Matthieu Labour, Engineering | *Action**X* |
584 Broadway, Suite 1002 – NY, NY 10012
415-994-3480 (m)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB