Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig and Storm


Copy link to this message
-
Re: Pig and Storm
Following projects might interest you:

Pig and Spark: https://github.com/twitter/pig/tree/spork
Storm and Hadoop:
https://speakerdeck.com/sritchie/summingbird-streaming-mapreduce-at-twitter

Thanks,
Aniket
On Tue, Jul 23, 2013 at 11:18 PM, Russell Jurney
<[EMAIL PROTECTED]>wrote:

> I think a Storm backend for Pig would be AWESOME. Btw, check out
> HStreaming. It's not FOSS, but shows there is demand.
> http://www.hstreaming.com/products/community/
>
> Russell Jurney http://datasyndrome.com
>
> On Jul 23, 2013, at 9:53 AM, Pradeep Gollakota <[EMAIL PROTECTED]>
> wrote:
>
> Hi Pig Developers,
>
> I wanted to reach out to you all and ask for you opinion on something.
>
> As a Pig user, I have come to love Pig as a framework. Pig provides a great
> set of abstractions that make working with large datasets easy. Currently
> Pig is only backed by hadoop. However, with the new rise of Twitter Storm
> as a distributed real time processing engine, Pig users are missing out on
> a great opportunity to be able to work with Pig in Storm. As a user of Pig,
> Hadoop and Storm, and keeping with the Pig philosophy of "Pigs live
> anywhere," I'd like to get your thoughts on starting the implementation of
> a Pig backend for Storm.
>
> Thanks
> Pradeep
>

--
"...:::Aniket:::... Quetzalco@tl"
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB