Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Python HDFS library


Copy link to this message
-
Python HDFS library
Hey hadoopers -

I've put together a python hdfs library and would love some feedback:

    http://github.com/traviscrawford/python-hdfs

Instead of wrapping the command-line ``hadoop`` tool like other python
hdfs libraries, this one uses ctypes to call libhdfs directly. It has
a file-like object for working with files, and a filesystem class for
interacting with non-file data.

I don't recommend using this in production yet, and not all methods
have been wrapped, but its usable and far enough along to demonstrate
this approach.

Thoughts/suggestions?

--travis
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB