Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: Hadoop archive not displaying files in the har


Copy link to this message
-
Re: Hadoop archive not displaying files in the har
John George 2012-09-07, 15:38
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.

So try the following instead:
hadoop archive  -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George

-----Original Message-----
From: Ajitabh Pandey <[EMAIL PROTECTED]>
Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Subject: Hadoop archive not displaying files in the har

>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive  -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw-------   5 ap users       9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw-------   5 ap users         24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw-------   3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info