Bjoern Schiessle 2010-08-09, 16:18
Philip Zeyliger 2010-08-09, 23:35
Bjoern Schiessle 2010-08-10, 12:06
Philip Zeyliger 2010-08-10, 16:39
-Re: Best way to write files to hdfs (from a Python app)
Travis Crawford 2010-08-11, 04:17
Has anyone had tried using swig to wrap libhdfs?
I spent some time today doing this, and it seems like it could be a
great solution, but its also a fair amount of work (especially having
never used swig before). If this seems generally worthwhile I could
finish it up.
Or is the thrift interface the API to use? Is anyone successfully using it?
I'm primarily interested in building some filesystem management +
reporting tools, so being slower than the Java interface is not
problematic. I'd prefer to not to parse the command-line tool output
On Tue, Aug 10, 2010 at 9:39 AM, Philip Zeyliger <[EMAIL PROTECTED]> wrote:
> On Tue, Aug 10, 2010 at 5:06 AM, Bjoern Schiessle <[EMAIL PROTECTED]>
>> Hi Philip,
>> On Mon, 9 Aug 2010 16:35:07 -0700 Philip Zeyliger wrote:
>> > To give you an example of how this may be done, HUE, under the covers,
>> > pipes your data to 'bin/hadoop fs -Dhadoop.job.ugi=user,group put -
>> > path'. (That's from memory, but it's approximately right; the full
>> > python code is at
>> > http://github.com/cloudera/hue/blob/master/desktop/libs/hadoop/src/hadoop/fs/hadoopfs.py#L692
>> > )
>> Thank you! If I understand it correctly this only works if my python app
>> runs on the same server as hadoop, right?
> It works only if your python app has network connectivity to your namenode.
> You can access an explicitly specified HDFS by passing
> -Dfs.default.name=hdfs://<namenode>:<namenode_port>/ . (The default is read
> from hadoop-site.xml (or perhaps hdfs-site.xml), and, I think, defaults to
Bjoern Schiessle 2010-08-11, 11:39
Jeff Hammerbacher 2010-08-11, 17:40
Bjoern Schiessle 2010-08-12, 12:01
David Rosenstrauch 2010-08-12, 13:43
Bjoern Schiessle 2010-08-12, 12:23
Bjoern Schiessle 2010-08-12, 14:31
stu24mail@... 2010-08-10, 16:02
Bjoern Schiessle 2010-08-12, 12:04
Stuart Smith 2010-08-12, 18:46