Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # dev >> Pig and Storm

Copy link to this message
Re: Pig and Storm
I think a Storm backend for Pig would be AWESOME. Btw, check out
HStreaming. It's not FOSS, but shows there is demand.

Russell Jurney http://datasyndrome.com

On Jul 23, 2013, at 9:53 AM, Pradeep Gollakota <[EMAIL PROTECTED]> wrote:

Hi Pig Developers,

I wanted to reach out to you all and ask for you opinion on something.

As a Pig user, I have come to love Pig as a framework. Pig provides a great
set of abstractions that make working with large datasets easy. Currently
Pig is only backed by hadoop. However, with the new rise of Twitter Storm
as a distributed real time processing engine, Pig users are missing out on
a great opportunity to be able to work with Pig in Storm. As a user of Pig,
Hadoop and Storm, and keeping with the Pig philosophy of "Pigs live
anywhere," I'd like to get your thoughts on starting the implementation of
a Pig backend for Storm.