Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Calling C inside MR


+
Mohammad Tariq 2012-12-03, 12:05
+
Simone Leo 2012-12-03, 13:41
+
Mohammad Tariq 2012-12-03, 13:52
+
Simone Leo 2012-12-03, 14:01
+
Mohammad Tariq 2012-12-03, 14:15
Copy link to this message
-
Re: Calling C inside MR
You provided the answer, JNI is a solution. Another one would be to use
hadoop streaming if your program can read stdin and write into stdout with
a good enough format.
A MR job is, in the end, plain java and does not impact how java can call
external process.

Bertrand

On Mon, Dec 3, 2012 at 1:05 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> Hello list,
>
>           I have a tool (written in C) that performs some different types
> of operations and can be used as a command line utility. I had to write a
> similar tool, as we have moved towards Hadoop platform for most of the
> things.
>
> Till now I have taken this tool as reference  and written MR jobs
> corresponding to some the modules of this tool and they are working fine.
> But I am wasting a lot of time in this. So, I just wanted to ask if it is
> possible to call this tool through a MR job?? Somewhat like JNI kinda
> thing. (I hope it is, otherwise I have to write rest of things from scratch
> and we are running out of time).
>
> Many thanks.
>
> Regards,
>     Mohammad Tariq
>
>
--
Bertrand Dechoux
+
Mohammad Tariq 2012-12-03, 13:03
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB