Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Sqoop exporting error


Copy link to this message
-
Re: Sqoop exporting error
Matthieu Labour 2012-11-06, 20:30
Jarcec
Please find below the versions
sqoop: sqoop-1.4.2.bin__hadoop-1.0.0.tar.gz
jdbc: postgresql-9.2-1000.jdbc4.jar
postgresql: PostgreSQL 9.1.3 on x86_64-unknown-linux-gnu, compiled by
gcc-4.4.real (Ubuntu 4.4.3-4ubuntu5.1) 4.4.3, 64-bit
hadoop: Hadoop 1.0.3 (Amazon Distribution)
Cheers
Matthieu

On Tue, Nov 6, 2012 at 2:33 PM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:

> Hi Matthieu,
> thank you very much for your outputs. I've took a look and I'm really not
> sure what is wrong. It seems that from strange reason sqoop submits for ts
> column value '[B@ba6c13' that seems to me an object address. But code
> that you've sent is correctly serializing long, so I'm really not sure what
> might be an issue here.
>
> What versions are you using? (Sqoop, Hadoop, Postgre SQL JDBC Driver)?
>
> Jarcec
>
> On Tue, Nov 06, 2012 at 01:17:00PM -0500, Matthieu Labour wrote:
> > Hi Jarcec
> >
> > I apologize for not getting back sooner to you. I live in NYC and life
> has
> > been hectic here with the hurricane. Thank you for taking the time to
> look
> > in my issue. Please find below the information requested.
> >
> >
> > 1. Here is the command being executed followed by the error produced.
> >  Attached is ml_ys_log_gmt_test.java
> >
> > ~/$SQOOP_ROOT/bin/sqoop export --connect jdbc:postgresql://
> > ec2-XX-XX-XXX-XX.compute-1.amazonaws.com:5662/dfg2tulf7263ut --username
> > ufjb0gfs1n5kut --password xxxxxxxxx  --table ml_ys_log_gmt_test
> > --export-dir $HADOOP_INPUT/$LOGS_HOME/dt=$(date +%Y-%m-%d)
> > --input-fields-terminated-by='\t' --lines-terminated-by='\n' --verbose
> > --batch
> >
> > 12/11/06 17:35:33 INFO mapred.JobClient: Task Id :
> > attempt_201211061658_0014_m_000000_0, Status : FAILED
> > java.io.IOException: java.sql.BatchUpdateException: Batch entry 71 INSERT
> > INTO ml_ys_log_gmt_test (date, ts, environment, resource, network,
> > advertiser, campaign, creative, cost, click, flavor, ui_element_id,
> > ui_element_type, event, charge_id, charge_type, charge_vertical,
> > charge_payer, charge_amount, model, imageformatsupport, inputmodesupport,
> > scriptsupport, vendor, stylesheetsupport, markupsupport, displaywidth,
> > cookiesupport, displayheight, version, inputdevices, displaycolordepth,
> > device_os, device_os_version, mobile_browser, mobile_browser_version,
> > is_tablet, dual_orientation, marketing_name) VALUES ('2012-10-31
> > 20:42:56.767000 +00:00:00', '[B@ba6c13',
> >
> 'remote-addr=10.84.101.45&user-agent=LG-CT810%2FV10x+NetFront%2Fv3.5+Profile%2FMIDP-2.0+Configuration%2FCLDC-1.1',
> > 'hxCA', 'MLNL', '1006', '10014', '1410', NULL, 'mdkP', '10014', '', '',
> > 'click', '', '', '', '', NULL, 'CT810', '', '', '', 'LG', '', '', '400',
> > '', '240', '', 'stylus', '', 'Windows Mobile OS', '6.1', 'Microsoft
> Mobile
> > Explorer', '7.11', 'false', 'false', '') was aborted.  Call
> > getNextException to see the cause.
> >         at
> >
> org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)
> >         at
> >
> org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:46)
> >         at
> >
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:646)
> >         at
> >
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> >         at
> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:78)
> >         at
> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:36)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> >
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:182)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:771)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:375)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
Matthieu Labour, Engineering | *Action**X* |
584 Broadway, Suite 1002 – NY, NY 10012
415-994-3480 (m)