Met with Lefty this afternoon and she was kind to spend time to add my documentation to the site - since I still don't have editing privileges :-)
Please review the new wikidoc about LZO compression in the Hive language manual. If anything is unclear or needs more information, you can email suggestions to this list or edit the wiki yourself (if you have editing privileges). Here are the links:
1. Language Manual<https://cwiki.apache.org/confluence/display/Hive/LanguageManual> (new bullet under File Formats)
2. LZO Compression<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LZO>
3. CREATE TABLE<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateTable> (near end of section, pasted in here:)
Use STORED AS TEXTFILE if the data needs to be stored as plain text files. Use STORED AS SEQUENCEFILE if the data needs to be compressed. Please read more about CompressedStorage<https://cwiki.apache.org/confluence/display/Hive/CompressedStorage> if you are planning to keep data compressed in your Hive tables. Use INPUTFORMAT and OUTPUTFORMAT to specify the name of a corresponding InputFormat and OutputFormat class as a string literal, e.g., 'org.apache.hadoop.hive.contrib.fileformat.base64.Base64TextInputFormat'. For LZO compression, the values to use are 'INPUTFORMAT "com.hadoop.mapred.DeprecatedLzoTextInputFormat" OUTPUTFORMAT "org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat"' (see LZO Compression<https://cwiki.apache.org/confluence/display/Hive/LanguageManual+LZO>).
My cwiki id is
It will be great if I could get edit privileges
=====================This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message along with any attachments, from your computer system. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's Email System Administrator.
Sanjay Subramanian 2013-07-31, 16:38
Sanjay Subramanian 2013-08-14, 22:52