-Re: calling C programs from Hadoop
Jeff Bean 2010-05-31, 16:24
Why did you determine that Hadoop streaming was insufficient for you?
On Mon, May 31, 2010 at 9:17 AM, Michael Robinson
> Hi Jef,
> I have a C program that processes very large data files which are
> compressed, so this program has to have full control of the process.
> the input data can be broken down into chunks, and a separate (distributed)
> process for each chunk can be run, which what I am doing now, but I am
> this manually at this time.
> I am looking to use a distributed system like Hadoop to do this so that i
> controls the scheduling and all those great things I have read about
> I was wondering if I can have Hadoop run a batch file (.bat in windows or
> .sh in linux), also I would like to run this in Virtual Machines.
> View this message in context:
> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.