Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Direct HDFS access from a streaming job


Copy link to this message
-
Re: Direct HDFS access from a streaming job
Keith Wiley 2011-03-24, 15:15
On Mar 23, 2011, at 11:10 PM, Harsh J wrote:

> There is a C-HDFS API + library (called libhdfs) available @
> http://hadoop.apache.org/common/docs/r0.20.2/libhdfs.html. Perhaps you
> can make your C++ mapper program use that?
Thanks.  Actually, I think that with reference to the passage I quoted in my first post, the unstated intent was to simply do a system() call and invoke "hadoop fs -get" or "hadoop fs -copyToLocal".

________________________________________________________________________________
Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com

"It's a fine line between meticulous and obsessive-compulsive and a slippery
rope between obsessive-compulsive and debilitatingly slow."
                                           --  Keith Wiley
________________________________________________________________________________