Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - task jvm bootstrapping via distributed cache


Copy link to this message
-
task jvm bootstrapping via distributed cache
Stan Rosenberg 2012-07-30, 22:23
Hi,

I am seeking a way to leverage hadoop's distributed cache in order to
ship jars that are required to bootstrap a task's jvm, i.e., before a
map/reduce task is launched.
As a concrete example, let's say that I need to launch with
'-javaagent:/path/profiler.jar'.  In theory, the task tracker is
responsible for downloading cached files onto its local filesystem.
However, the absolute path to a given cached file is not known a
priori; however, we need the path in order to configure '-javaagent'.

Is this currently possible with the distributed cache? If not, is the
use case appealing enough to open a jira ticket?

Thanks,

stan
+
Stan Rosenberg 2012-07-31, 15:55
+
Arun C Murthy 2012-08-03, 06:39
+
Stan Rosenberg 2012-08-03, 16:32
+
Harsh J 2012-08-03, 17:31
+
Stan Rosenberg 2012-08-03, 18:32
+
Stan Rosenberg 2013-01-17, 19:32
+
Stan Rosenberg 2013-01-18, 01:28
+
Arun C Murthy 2012-08-03, 20:19
+
Stan Rosenberg 2012-08-03, 20:57
+
rahul p 2012-08-05, 05:35