Stan Rosenberg 2012-07-30, 22:23
Stan Rosenberg 2012-07-31, 15:55
-Re: task jvm bootstrapping via distributed cache
Arun C Murthy 2012-08-03, 06:39
You can ask TT to create a symlink to your jar shipped via DistCache:
That should give you what you want.
On Jul 30, 2012, at 3:23 PM, Stan Rosenberg wrote:
> I am seeking a way to leverage hadoop's distributed cache in order to
> ship jars that are required to bootstrap a task's jvm, i.e., before a
> map/reduce task is launched.
> As a concrete example, let's say that I need to launch with
> '-javaagent:/path/profiler.jar'. In theory, the task tracker is
> responsible for downloading cached files onto its local filesystem.
> However, the absolute path to a given cached file is not known a
> priori; however, we need the path in order to configure '-javaagent'.
> Is this currently possible with the distributed cache? If not, is the
> use case appealing enough to open a jira ticket?
Arun C. Murthy
Stan Rosenberg 2012-08-03, 16:32
Harsh J 2012-08-03, 17:31
Stan Rosenberg 2012-08-03, 18:32
Stan Rosenberg 2013-01-17, 19:32
Stan Rosenberg 2013-01-18, 01:28
Arun C Murthy 2012-08-03, 20:19
Stan Rosenberg 2012-08-03, 20:57
rahul p 2012-08-05, 05:35