Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> LZO compression implementation in Hive

Sanjay Subramanian 2013-05-20, 21:51
Copy link to this message
Re: LZO compression implementation in Hive
Hi Sanjay,

Can you quickly give your insights on thip topic, if possible?

On Mon, May 20, 2013 at 2:51 PM, Sanjay Subramanian <

>  Hi Programming Hive Book authors
>  Maybe a lot of u have already successfully implemented this but only
> these last two weeks , we implemented our aggregations using LZO
> compression in Hive - MR jobs creating LZO files as Input for Hive --->
> Therafter Hive aggregations creating more LZO files as output.
> As usual nothing was straight forward :-)  Also the other challenge was to
> neatly tie all into actions in Oozie workflows….but after being underwater
> for weeks I think I am able to  rise above water and breathe !
>  In the next version of the book , If u guys r planning to add detailed
> sections on using lzo compression in Hive , let me know…my experiences
> might be useful :-)
>  Thanks
>  sanjay
> =====================> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the
> sender by reply email and destroy all copies of the original message along
> with any attachments, from your computer system. If you are the intended
> recipient, please be advised that the content of this message is subject to
> access, review and disclosure by the sender's Email System Administrator.
Lefty Leverenz 2013-06-18, 02:08
Sanjay Subramanian 2013-06-18, 06:50
Sanjay Subramanian 2013-06-18, 06:56
Sanjay Subramanian 2013-06-18, 22:02