Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> streaming cacheArchive shared libraries


Copy link to this message
-
Re: streaming cacheArchive shared libraries
Okay, I think I understand.  The symlink name that follows the pound sign in the -cacheArchive directive isn't the name of the transferred jar file -- it is the name of a directory that the .jar file will be put into and then be unjarred.  So, it doesn't act like like jar would on a local machine, where files are recreated at the current directory level.  Rather, everything is pushed down by one level.  Wish a corresponding cmddev flag to point LD_LIBRARY_PATH to the correct location, I think I can get it to find the shared libraries now.

On Aug 5, 2011, at 10:27 , Keith Wiley wrote:

> Quick followup.  I substituted the true mapper for a little python script that just lists the cwd's contents and dumps them to the streaming output (stderr).  Oddly, I it doesn't look like the .jar far was unpacked.  I can see it there, but not the unpacked version, so it looks like -cacheArchive transferred the file but didn't unjar it.
>
> Anyone ever seen something like this before?
________________________________________________________________________________
Keith Wiley     [EMAIL PROTECTED]     keithwiley.com    music.keithwiley.com

"And what if we picked the wrong religion?  Every week, we're just making God
madder and madder!"
                                           --  Homer Simpson
________________________________________________________________________________
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB