Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - external table or gz compressed file

Copy link to this message
external table or gz compressed file
Panshul Whisper 2013-05-02, 13:00

Can somebody please explain me or point me in the right direction for :
how Hive handles gz compressed files, If I create an external table
pointing to a .gz compressed file stored on AWS S3.
Does hive copy the file to the HDFS and decompress it before it uses the
OR does it use the file directly?
If we use a decompressed file stored on S3... does hive still copy the file
to HDFS or read records directly from S3?

Please help me understand the working.

Thanking You,

Ouch Whisper
Sanjay Subramanian 2013-05-02, 17:33