Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Python HDFS library


Copy link to this message
-
Python HDFS library
Travis Crawford 2010-08-26, 02:52
Hey hadoopers -

I've put together a python hdfs library and would love some feedback:

    http://github.com/traviscrawford/python-hdfs

Instead of wrapping the command-line ``hadoop`` tool like other python
hdfs libraries, this one uses ctypes to call libhdfs directly. It has
a file-like object for working with files, and a filesystem class for
interacting with non-file data.

I don't recommend using this in production yet, and not all methods
have been wrapped, but its usable and far enough along to demonstrate
this approach.

Thoughts/suggestions?

--travis