Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Pig and Storm


Copy link to this message
-
Re: Pig and Storm
Aniket Mokashi 2013-07-24, 06:49
Following projects might interest you:

Pig and Spark: https://github.com/twitter/pig/tree/spork
Storm and Hadoop:
https://speakerdeck.com/sritchie/summingbird-streaming-mapreduce-at-twitter

Thanks,
Aniket
On Tue, Jul 23, 2013 at 11:18 PM, Russell Jurney
<[EMAIL PROTECTED]>wrote:

> I think a Storm backend for Pig would be AWESOME. Btw, check out
> HStreaming. It's not FOSS, but shows there is demand.
> http://www.hstreaming.com/products/community/
>
> Russell Jurney http://datasyndrome.com
>
> On Jul 23, 2013, at 9:53 AM, Pradeep Gollakota <[EMAIL PROTECTED]>
> wrote:
>
> Hi Pig Developers,
>
> I wanted to reach out to you all and ask for you opinion on something.
>
> As a Pig user, I have come to love Pig as a framework. Pig provides a great
> set of abstractions that make working with large datasets easy. Currently
> Pig is only backed by hadoop. However, with the new rise of Twitter Storm
> as a distributed real time processing engine, Pig users are missing out on
> a great opportunity to be able to work with Pig in Storm. As a user of Pig,
> Hadoop and Storm, and keeping with the Pig philosophy of "Pigs live
> anywhere," I'd like to get your thoughts on starting the implementation of
> a Pig backend for Storm.
>
> Thanks
> Pradeep
>

--
"...:::Aniket:::... Quetzalco@tl"