Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - Exporting hive table data into oracle give date format error


+
Ajit Kumar Shreevastava 2013-03-13, 13:43
+
Jarek Jarcec Cecho 2013-03-16, 22:58
+
Ajit Kumar Shreevastava 2013-03-19, 08:13
Copy link to this message
-
Re: Exporting hive table data into oracle give date format error
Jarek Jarcec Cecho 2013-03-19, 21:25
Hi Ajit,
thank you for sharing the additional data. I've noticed in your data that some of the columns are using \N to denote the NULL value, however some other columns are using string constant "null" (that do not denote NULL in Hive). This also seems to be the case for column DEL_TS. My guess is that Sqoop is trying to decode the "null" string as the timestamp and failing on the "Timestamp format must be..." exception. I would recommend to unify the null representation tokens and run Sqoop export with appropriate one.

Jarcec

On Tue, Mar 19, 2013 at 08:13:01AM +0000, Ajit Kumar Shreevastava wrote:
> Hi Jercec,
>
>
>
> Thank you for your valuable suggestions.
>
>
>
> I have applied the below suggestion and re-do all the process again with the SQOOP1.4.3 (sqoop-1.4.3.bin__hadoop-1.0.0.tar.gz) but I have face same below error again. Please suggest me.
>
>
>
> Here I have created table in hive as  suggested by you.
>
>
>
> hive> create table bttn_bkp_testing like bttn_bkp_test;
>
> hive> insert OVERWRITE table bttn_bkp_testing
>
>         > select * from bttn_bkp_test;
>
>
>
> I am also attaching the error file generated by task tracker for your analysis.
>
> It fails for bttn_id = 194628
>
>
>
> I have queried both the table and records are like
>
>
>
> hive> select * from bttn_bkp_testing
>
>     > where bttn_id=194628;
>
>
>
> 194628.0        577019.0        8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-04-19 23:25:48.78  ei009724        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
> 194628.0        706360.0        8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-05-21 01:01:53.629 ei103215        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
> 194628.0        1620395.0       8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-08-10 04:34:00.203 ei103215        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
> 194628.0        1694103.0       8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-11-08 01:09:15.136 ei103215        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
> 194628.0        1831767.0       8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-12-19 23:44:44.241 e0025129        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
>
>
> And
>
> hive> select * from bttn_bkp_test_new
>
>     > where bttn_id=194628;
>
>
>
> 194628.0        577019.0        8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-04-19 23:25:48.78  ei009724        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
>
> 194628.0        706360.0        8910.0  19.0    1.0     1.0     1.0     0.0     0.0     #FFFFFF #FF0000 #FF0000 #FFFFFF 0.0     0.0     1646.0  NULL    NULL    NULL   1.0      NULL    null    20.0    2012-05-21 01:01:53.629 ei103215        2013-01-18 09:11:30.245 DP_CQ4540       null    null    0.0     BLUEBERRY MUFFIN        7836.0 null     NULL    0.0     61259.0 61230.0 61230.0 61259.0
+
Ajit Kumar Shreevastava 2013-03-20, 07:30
+
Jarek Jarcec Cecho 2013-03-21, 00:48
+
Ajit Kumar Shreevastava 2013-03-21, 06:34
+
Jarek Jarcec Cecho 2013-03-21, 15:33
+
Ajit Kumar Shreevastava 2013-03-22, 07:37
+
Venkat 2013-03-21, 18:30
+
Jarek Jarcec Cecho 2013-03-22, 02:54
+
Venkat Ranganathan 2013-03-22, 03:24
+
Jarek Jarcec Cecho 2013-03-22, 03:46