|
|
hadoop hive 2012-02-27, 06:16
Hey folks,
i m using hadoop 0.20.2 + r911707 , please tell me the installation and how to use snappy for compression and decompression
Regards Vikas Srivastava
+
hadoop hive 2012-02-27, 06:16
+
alo alt 2012-02-27, 06:20
hadoop hive 2012-02-27, 06:28
thanks Alex, i m using Apache hadoop, steps i followed 1:- untar snappy 2:- entry in mapred site this can be used like deflate only(like only on overwriting file) On Mon, Feb 27, 2012 at 11:50 AM, alo alt <[EMAIL PROTECTED]> wrote: > Hi, > > > https://ccp.cloudera.com/display/CDHDOC/Snappy+Installation#SnappyInstallation-UsingSnappyforMapReduceCompression> > best, > Alex > > -- > Alexander Lorenz > http://mapredit.blogspot.com> > On Feb 27, 2012, at 7:16 AM, hadoop hive wrote: > > > Hey folks, > > > > i m using hadoop 0.20.2 + r911707 , please tell me the installation and > how > > to use snappy for compression and decompression > > > > Regards > > Vikas Srivastava > >
+
hadoop hive 2012-02-27, 06:28
alo alt 2012-02-27, 06:59
After you have installed snappy you have to configure the codec like the URL I posted before or you can reference them in your MR jobs. Be sure you have the jars in your classpath for. For storing snappy compressed files in HDFS you should use Pig or Flume. -- Alexander Lorenz http://mapredit.blogspot.comOn Feb 27, 2012, at 7:28 AM, hadoop hive wrote: > thanks Alex, > > i m using Apache hadoop, steps i followed > > 1:- untar snappy > 2:- entry in mapred site > > this can be used like deflate only(like only on overwriting file) > > > > On Mon, Feb 27, 2012 at 11:50 AM, alo alt <[EMAIL PROTECTED]> wrote: > >> Hi, >> >> >> https://ccp.cloudera.com/display/CDHDOC/Snappy+Installation#SnappyInstallation-UsingSnappyforMapReduceCompression>> >> best, >> Alex >> >> -- >> Alexander Lorenz >> http://mapredit.blogspot.com>> >> On Feb 27, 2012, at 7:16 AM, hadoop hive wrote: >> >>> Hey folks, >>> >>> i m using hadoop 0.20.2 + r911707 , please tell me the installation and >> how >>> to use snappy for compression and decompression >>> >>> Regards >>> Vikas Srivastava >> >>
+
alo alt 2012-02-27, 06:59
hadoop hive 2012-02-27, 07:14
hey Alex, i cant you hive for that.??? On Mon, Feb 27, 2012 at 12:29 PM, alo alt <[EMAIL PROTECTED]> wrote: > After you have installed snappy you have to configure the codec like the > URL I posted before or you can reference them in your MR jobs. Be sure you > have the jars in your classpath for. > > For storing snappy compressed files in HDFS you should use Pig or Flume. > > -- > Alexander Lorenz > http://mapredit.blogspot.com> > On Feb 27, 2012, at 7:28 AM, hadoop hive wrote: > > > thanks Alex, > > > > i m using Apache hadoop, steps i followed > > > > 1:- untar snappy > > 2:- entry in mapred site > > > > this can be used like deflate only(like only on overwriting file) > > > > > > > > On Mon, Feb 27, 2012 at 11:50 AM, alo alt <[EMAIL PROTECTED]> > wrote: > > > >> Hi, > >> > >> > >> > https://ccp.cloudera.com/display/CDHDOC/Snappy+Installation#SnappyInstallation-UsingSnappyforMapReduceCompression> >> > >> best, > >> Alex > >> > >> -- > >> Alexander Lorenz > >> http://mapredit.blogspot.com> >> > >> On Feb 27, 2012, at 7:16 AM, hadoop hive wrote: > >> > >>> Hey folks, > >>> > >>> i m using hadoop 0.20.2 + r911707 , please tell me the installation and > >> how > >>> to use snappy for compression and decompression > >>> > >>> Regards > >>> Vikas Srivastava > >> > >> > >
+
hadoop hive 2012-02-27, 07:14
alo alt 2012-02-27, 07:19
hive? You are then on the wrong list, for hive related questions refer to: [EMAIL PROTECTED] -- Alexander Lorenz http://mapredit.blogspot.comOn Feb 27, 2012, at 8:14 AM, hadoop hive wrote: > hey Alex, > > i cant you hive for that.??? > > On Mon, Feb 27, 2012 at 12:29 PM, alo alt <[EMAIL PROTECTED]> wrote: > >> After you have installed snappy you have to configure the codec like the >> URL I posted before or you can reference them in your MR jobs. Be sure you >> have the jars in your classpath for. >> >> For storing snappy compressed files in HDFS you should use Pig or Flume. >> >> -- >> Alexander Lorenz >> http://mapredit.blogspot.com>> >> On Feb 27, 2012, at 7:28 AM, hadoop hive wrote: >> >>> thanks Alex, >>> >>> i m using Apache hadoop, steps i followed >>> >>> 1:- untar snappy >>> 2:- entry in mapred site >>> >>> this can be used like deflate only(like only on overwriting file) >>> >>> >>> >>> On Mon, Feb 27, 2012 at 11:50 AM, alo alt <[EMAIL PROTECTED]> >> wrote: >>> >>>> Hi, >>>> >>>> >>>> >> https://ccp.cloudera.com/display/CDHDOC/Snappy+Installation#SnappyInstallation-UsingSnappyforMapReduceCompression>>>> >>>> best, >>>> Alex >>>> >>>> -- >>>> Alexander Lorenz >>>> http://mapredit.blogspot.com>>>> >>>> On Feb 27, 2012, at 7:16 AM, hadoop hive wrote: >>>> >>>>> Hey folks, >>>>> >>>>> i m using hadoop 0.20.2 + r911707 , please tell me the installation and >>>> how >>>>> to use snappy for compression and decompression >>>>> >>>>> Regards >>>>> Vikas Srivastava >>>> >>>> >> >>
+
alo alt 2012-02-27, 07:19
hadoop hive 2012-02-27, 07:36
okk.. can i built it with ANT On Mon, Feb 27, 2012 at 12:49 PM, alo alt <[EMAIL PROTECTED]> wrote: > hive? > You are then on the wrong list, for hive related questions refer to: > [EMAIL PROTECTED] > > -- > Alexander Lorenz > http://mapredit.blogspot.com> > On Feb 27, 2012, at 8:14 AM, hadoop hive wrote: > > > hey Alex, > > > > i cant you hive for that.??? > > > > On Mon, Feb 27, 2012 at 12:29 PM, alo alt <[EMAIL PROTECTED]> > wrote: > > > >> After you have installed snappy you have to configure the codec like the > >> URL I posted before or you can reference them in your MR jobs. Be sure > you > >> have the jars in your classpath for. > >> > >> For storing snappy compressed files in HDFS you should use Pig or Flume. > >> > >> -- > >> Alexander Lorenz > >> http://mapredit.blogspot.com> >> > >> On Feb 27, 2012, at 7:28 AM, hadoop hive wrote: > >> > >>> thanks Alex, > >>> > >>> i m using Apache hadoop, steps i followed > >>> > >>> 1:- untar snappy > >>> 2:- entry in mapred site > >>> > >>> this can be used like deflate only(like only on overwriting file) > >>> > >>> > >>> > >>> On Mon, Feb 27, 2012 at 11:50 AM, alo alt <[EMAIL PROTECTED]> > >> wrote: > >>> > >>>> Hi, > >>>> > >>>> > >>>> > >> > https://ccp.cloudera.com/display/CDHDOC/Snappy+Installation#SnappyInstallation-UsingSnappyforMapReduceCompression> >>>> > >>>> best, > >>>> Alex > >>>> > >>>> -- > >>>> Alexander Lorenz > >>>> http://mapredit.blogspot.com> >>>> > >>>> On Feb 27, 2012, at 7:16 AM, hadoop hive wrote: > >>>> > >>>>> Hey folks, > >>>>> > >>>>> i m using hadoop 0.20.2 + r911707 , please tell me the installation > and > >>>> how > >>>>> to use snappy for compression and decompression > >>>>> > >>>>> Regards > >>>>> Vikas Srivastava > >>>> > >>>> > >> > >> > >
+
hadoop hive 2012-02-27, 07:36
|
|