Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> HDFS VFS Driver


Copy link to this message
-
Re: HDFS VFS Driver
Michael,

Please open a jira (new feature) and attach your patch there:
http://wiki.apache.org/hadoop/HowToContribute

thanks,
Arun

On Jun 16, 2010, at 8:55 AM, Michael D'Amour wrote:

> We have an open source ETL tool (Kettle) which uses VFS for many
> input/output steps/jobs.  We would like to be able to read/write HDFS
> from Kettle using VFS.
>
> I haven't been able to find anything out there other than "it would be
> nice."
>
> I had some time a few weeks ago to begin writing a VFS driver for HDFS
> and we (Pentaho) would like to be able to contribute this driver.  I
> believe it supports all the major file/folder operations and I have
> written unit tests for all of these operations.  The code is currently
> checked into an open Pentaho SVN repository under the Apache 2.0
> license.  There are some current limitations, such as a lack of
> authentication (kerberos), which appears to be coming in 0.22.0,
> however, the driver supports username/password, but I just can't use
> them yet.
>
> Please let me know how to proceed with the contribution process.
>
> Thank you.
> -Mike
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB