Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: Hadoop archive not displaying files in the har


Copy link to this message
-
Re: Hadoop archive not displaying files in the har
My guess is that harchive does not like to be given a set of files as its
input, but rather a directory.

So try the following instead:
hadoop archive  -Dmapred.job.queue.name=myqueue -archiveName
test.har -p /my/dir/path subdir1/ /my/dir/path/some-target-directory
Regards,
John George

-----Original Message-----
From: Ajitabh Pandey <[EMAIL PROTECTED]>
Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Date: Fri, 7 Sep 2012 05:55:00 -0700
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Subject: Hadoop archive not displaying files in the har

>Hi,
>
>I created a hadoop archive as follows:
>
>$ hadoop archive  -Dmapred.job.queue.name=myqueue -archiveName
>test.har -p /my/dir/path subdir1/some-file-name-*.gz
>/my/dir/path/some-target-directory
>
>The map reduce job runs fine and when the job finishes I see the
>following:
>
>$ hadoop fs -ls /my/dir/path/some-target-directory/test.har
>Found 3 items
>-rw-------   5 ap users       9199 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_index
>-rw-------   5 ap users         24 2012-09-07 12:30
>/my/dir/path/some-target-directory/test.har/_masterindex
>-rw-------   3 ap users 3367997136 2012-09-07 12:28
>/my/dir/path/some-target-directory/test.har/part-0
>
>But when I do
>
>$ hadoop fs -lsr har:///my/dir/path/some-target-directory/test.har/
>
>I don't get an output, I just get the $ prompt back.
>
>Any idea what is wrong here?
>
>Regards.
>--
>Ajitabh Pandey
>http://ajitabhpandey.info
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB