Manhee Jo 2011-07-07, 01:52
Rita 2011-06-27, 10:06
Joey Echeverria 2011-06-27, 14:10
-Re: tar or hadoop archive
Rita 2011-06-27, 23:36
So, it does an index of the file?
On Mon, Jun 27, 2011 at 10:10 AM, Joey Echeverria <[EMAIL PROTECTED]> wrote:
> The advantage of a hadoop archive files is it lets you access the
> files stored in it directly. For example, if you archived three files
> (a.txt, b.txt, c.txt) in an archive called foo.har. You could cat one
> of the three files using the hadoop command line:
> hadoop fs -cat har:///user/joey/out/foo.har/a.txt
> You can also copy files out of the archive or use files in the archive
> as input to map reduce jobs.
> On Mon, Jun 27, 2011 at 3:06 AM, Rita <[EMAIL PROTECTED]> wrote:
> > We use hadoop/hdfs to archive data. I archive a lot of file by creating
> > large tar file and then placing to hdfs. Is it better to use hadoop
> > for this or is it essentially the same thing?
> > --
> > --- Get your facts first, then you can distort them as you please.--
> Joseph Echeverria
> Cloudera, Inc.
--- Get your facts first, then you can distort them as you please.--
Joey Echeverria 2011-06-27, 23:46