Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - LZO compression implementation in Hive

Copy link to this message
Re: LZO compression implementation in Hive
Lefty Leverenz 2013-06-18, 02:08
Perhaps you'd like to write up your insights in the Hive wiki, and others
could add their insights.  Then the information would be available to all,

– Lefty

On Mon, Jun 17, 2013 at 4:39 PM, Ramki Palle <[EMAIL PROTECTED]> wrote:

> Hi Sanjay,
> Can you quickly give your insights on thip topic, if possible?
> Regards,
> Ramki.
> On Mon, May 20, 2013 at 2:51 PM, Sanjay Subramanian <
>>  Hi Programming Hive Book authors
>>  Maybe a lot of u have already successfully implemented this but only
>> these last two weeks , we implemented our aggregations using LZO
>> compression in Hive - MR jobs creating LZO files as Input for Hive --->
>> Therafter Hive aggregations creating more LZO files as output.
>> As usual nothing was straight forward :-)  Also the other challenge was
>> to neatly tie all into actions in Oozie workflows….but after being
>> underwater for weeks I think I am able to  rise above water and breathe !
>>  In the next version of the book , If u guys r planning to add detailed
>> sections on using lzo compression in Hive , let me know…my experiences
>> might be useful :-)
>>  Thanks
>>  sanjay
>> =====================>> This email message and any attachments are for the exclusive use of the
>> intended recipient(s) and may contain confidential and privileged
>> information. Any unauthorized review, use, disclosure or distribution is
>> prohibited. If you are not the intended recipient, please contact the
>> sender by reply email and destroy all copies of the original message along
>> with any attachments, from your computer system. If you are the intended
>> recipient, please be advised that the content of this message is subject to
>> access, review and disclosure by the sender's Email System Administrator.