Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Hive error: Unable to deserialize reduce input key


+
praveenesh kumar 2012-03-23, 13:05
Copy link to this message
-
Re: Hive error: Unable to deserialize reduce input key
Hi  praveenesh kumar  :
I am getting the same error today.
Do you have any solution ?
2012/3/23 praveenesh kumar <[EMAIL PROTECTED]>

> Hi all,
>
> I am getting this following error when I am trying to do select ...with
> group by operation.I am grouping on around 25 columns
>
> java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException:
> Hive Runtime Error: Unable to deseralize reduce input key from
> x1x128x0x0x0x0x1x254x174x1x49x55x52x46x50x53x52x46x49x46x48x0x1x142x145x93x11x1x128x87x4x73x1x128x32x107x137x1x130x165x214x131x1x49x0x1x51x48x48x120x53x48x0x1x132x11x106x192x1x128x13x178x250x1x128x0x1x0x1x78x86x0x1x55x48x50x0x1x56x57x48x53x52x0x1x50x48x54x0x1x49x51x51x55x51x0x1x48x0x1x48x46x48x0x1x48x0x1x49x55x53x55x52x54x56x55x0x1x48x0x1x0x1x0x1x0x1x0x255
> ...
>
>
> Detailed logs...
>
> 2012-03-23 06:31:42,187 FATAL ExecReducer:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error:
> Unable to deserialize reduce input key from
> x1x128x0x0x0x0x0x87x66x1x54x54x46x56x55x46x48x46x48x0x1x142x124x217x207x1x128x86x17x13x1x128x29x65x57x1x130x141x82x245x1x49x0x1x49x56x48x120x49x53x48x0x1x131x235x47x199x1x128x10x161x93x1x128x0x1x0x1x73x76x0x1x55x55x51x0x1x54x48x54x50x57x0x1x56x55x0x1x49x51x51x49x48x0x1x53x0x1x56x46x48x0x1x50x50x0x1x50x52x51x57x49x52x55x56x0x1x48x0x1x0x1x0x1x0x1x0x255
> with properties
> {columns=_col0,_col1,_col2,_col3,_col4,_col5,_col6,_col7,_col8,_col9,_col10,_col11,_col12,_col13,_col14,_col15,_col16,_col17,_col18,_col19,_col20,_col21,_col22,_col23,_col24,
> serialization.sort.order=+++++++++++++++++++++++++,
> columns.types=bigint,string,int,int,int,int,string,string,int,int,int,string,string,string,string,string,string,string,string,string,string,double,string,string,double}
>                 at
> org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:204)
>                 at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:519)
>                 at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420)
>                 at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>                 at java.security.AccessController.doPrivileged(Native
> Method)
>                 at javax.security.auth.Subject.doAs(Subject.java:396)
>                 at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>                 at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: org.apache.hadoop.hive.serde2.SerDeException:
> java.io.EOFException
>                 at
> org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:173)
>                 at
> org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:202)
>                 ... 7 more
> Caused by: java.io.EOFException
>                 at
> org.apache.hadoop.hive.serde2.binarysortable.InputByteBuffer.read(InputByteBuffer.java:54)
>                 at
> org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:183)
>                 at
> org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:169)
>                 ... 8 more
>
>
> Any help would be highly appreciated as I am kind of stuck here.
>
> Thanks.
>

--
Best wishs!
曹 坤
+
praveenesh kumar 2012-09-07, 04:21
+
Navis류승우 2012-09-07, 05:14
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB