Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Spring for hadoop


Copy link to this message
-
Re: Spring for hadoop
Hello Radim,

Your solution sounds interesting. Is it possible for me to try the solution
before I buy it?

Thnx ,
Regards
On Wed, Jan 23, 2013 at 1:07 AM, Radim Kolar <[EMAIL PROTECTED]> wrote:

> i have solution integrating spring beans and spring batch directly into
> hadoop core. its far more advanced then spring data hadoop support with
> pojo patch.
>
> in my solution every component of mapreduce can be hadoop bean. You will
> get spring batch integrated directly into mapper, which means that you can
> run multiple steps in one mapper pass and because of async write done by
> spring batch you will get about 3x higher write performance. i have
> rewriten HDFS which has way faster writes. Spring batch component replaces
> standard hadoop job manager (that thing with web gui) and spring
> integration is used for advanced stuff like multiresource scheduling. You
> can write simple java bean for every new resource you want to add into
> system and another bean for logic for assigning jobs based on that
> particular resource.
>
> I submitted few patches to hadoop but they were not interesting enough to
> get into core. If you want to buy my hadoop with integrated spring, let me
> know.
>

--
Regards,
Ouch Whisper
010101010101
+
Jilani Shaik 2013-01-19, 06:13
+
Jilani Shaik 2013-01-19, 06:20
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB