Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: How to support the (HDFS) FileSystem API of various Hadoop Distributions?


Copy link to this message
-
Re: How to support the (HDFS) FileSystem API of various Hadoop Distributions?
Hello,

There are a few additions to the FileSystem that may bite you across
versions, but if you pick an old stable version such as Apache Hadoop
0.20.2, and stick to only its offered APIs, it would work better
across different version dependencies as we try to maintain FileSystem
as a stable interface as much as we can (there was also more recent
work to ensure the stabilization). I looked over your current code
state and it seemed to have pretty stable calls that I think have
existed across several versions and exists today, but I did notice you
had to remove an isRoot as part of a previous commit, which may have
lead to this question?

If that doesn't work for you, you can also switch out to using
sub-modules carrying code specific to a build version type (such as
what HBase does at https://github.com/apache/hbase/tree/trunk/ (see
the hbase-hadoop-compat directories)).

On Fri, Sep 6, 2013 at 2:59 AM, Christian Schneider
<[EMAIL PROTECTED]> wrote:
> Hi,
> I start to write a small ncdu clone to browse HDFS on the CLI
> (http://nchadoop.org/). Currently i'm testing it against CDH4, - but I like
> to make it available for a wider group of users (Hortonworks, ..).
>
> Is it enough to pick different vanilla Versions (for IPC 5, 7)?
>
> Best Regards,
> Christian.
>

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB