-Re: linux containers with Hadoop
Edward Capriolo 2011-09-30, 17:39
On Fri, Sep 30, 2011 at 9:03 AM, bikash sharma <[EMAIL PROTECTED]>wrote:
> Does anyone knows if Linux containers (which are like kernel supported
> virtualization technique for providing resource isolation across
> process/appication) have ever been used with Hadoop to provide resource
> isolation for map/reduce tasks?
> If yes, what could be the up/down sides of such approach and how feasible
> is in the context of Hadoop?
> Any pointers if any in terms of papers, etc would be useful.
Previously hadoop launched map reduce tasks as a single user, now with
security tasks can launch as different users in the same OS/VM. I would say
the closest you can to that isolation is the work done with mesos .