Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Error While Processing SequeceFile with Lzo Compressed in hive External table (CDH4.3)


Copy link to this message
-
Re: Error While Processing SequeceFile with Lzo Compressed in hive External table (CDH4.3)
Nitin Pawar 2013-06-20, 06:38
Search for Sanjay's email in last few days.
He had mentioned how did he do it
On Thu, Jun 20, 2013 at 10:48 AM, samir das mohapatra <
[EMAIL PROTECTED]> wrote:

> Dear All,
>
>  Any One would have face this type of Issue ?
>
>   I am getting Some error while processing Sequecen file with LZO
> compresss in hive query  In CDH4.3.x Distribution.
>
> Error Logs:
>
> SET hive.exec.compress.output=true;
>
> SET mapred.output.compression.codec=com.hadoop.compression.lzo.LzopCodec;
>
>
>
> -rw-r--r--   3 myuser supergroup      25172 2013-06-19 21:25 /user/myDir/000000_0  -- Lzo Compressed sequence file
>
>
>
> -rw-r--r--   3 myuser   supergroup      71007 2013-06-19 21:42 /user/myDir/000000_0   -- Normal sequence file
>
>
>
> 1.       Now the problem that if I create an External table on top of the
> directory to read the data it gives me an error : *Failed with exception
> java.io.IOException:java.io.EOFException: Premature EOF from inputStream*
>
> *
> *
>
> *Table Creation:*
>
> *
> *
>
> *
> *
>
> CREATE EXTERNAL TABLE IF NOT EXISTS MyTable
>
> (
>
> userip  string
>
> usertid string
>
> )
>
> ROW FORMAT DELIMITED
>
>    FIELDS TERMINATED BY '\001'  ESCAPED BY '\020'
>
>    COLLECTION ITEMS TERMINATED BY '\002'
>
>    MAP KEYS TERMINATED BY '\003'
>
>    LINES TERMINATED BY '\012'
>
> STORED AS SEQUENCEFILE
>
> LOCATION '/path/to/file';
>
>
> After that while querying to the table getting error:
>
>
> *Failed with exception java.io.IOException:java.io.EOFException:
> Premature EOF from inputStream*
> *
> *
> *Why it is like that?*
> *
> *
> *Regards,*
> *samir*
>
> *
> *
>
> *
> *
>
> *
> *
>
> *T*
>
> *
> *
>
> *
> *
>
> *
> *
>
>
>

--
Nitin Pawar