Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Put a "Google summer of code 2013" cwiki page


+
Daniel Dai 2013-03-21, 01:25
+
Russell Jurney 2013-03-21, 18:54
+
Olga Natkovich 2013-03-21, 19:51
+
Prasanth J 2013-03-21, 21:05
+
Dmitriy Ryaboy 2013-03-22, 17:04
+
Johnny Zhang 2013-03-26, 20:40
+
Daniel Dai 2013-04-24, 19:00
Copy link to this message
-
Re: Put a "Google summer of code 2013" cwiki page
Ops, sorry, only committer can mentor. But you can create the ticket
anyway. Thanks!
On Wed, Apr 24, 2013 at 12:00 PM, Daniel Dai <[EMAIL PROTECTED]> wrote:

> Hi, Johnny,
> If you want to mentor this in GSoC, please create a Jira ticket and label
> it gsoc2013.
>
> Thanks,
> Daniel
>
>
> On Tue, Mar 26, 2013 at 1:40 PM, Johnny Zhang <[EMAIL PROTECTED]>wrote:
>
>> I have another idea for GSoC project: parallel running the unit tests. I
>> think several people mentioned this in last Pig meetup. The objective is
>> enabling us to run whole unit tests before commit any patch. The fix
>> should
>> include two parts:
>>
>> (1) unit test doesn't interferes each other (e.g. moving test dir from
>> /tmp
>> to build/test/tmp so test doesn't delete other test's dir)
>> (2) need to make sure Pig is thread safe
>>
>> Johnny
>>
>>
>> On Fri, Mar 22, 2013 at 10:04 AM, Dmitriy Ryaboy <[EMAIL PROTECTED]>
>> wrote:
>>
>> > This is a little different than how we've done such things before, but
>> how
>> > about a project to get Pig to run on Spark (aka, Spork)? The Twitter pig
>> > folks have some code we'd love to share that got us half-way there, it
>> was
>> > looking pretty promising (if anyone is curious, it's the "spork" branch
>> on
>> > my github fork of pig: https://github.com/dvryaboy/pig )
>> >
>> > D
>> >
>> > On Thu, Mar 21, 2013 at 2:05 PM, Prasanth J <[EMAIL PROTECTED]
>> > >wrote:
>> >
>> > > One more idea for GSoC project.
>> > >
>> > > YSmart uses correlation between multiple MR jobs to reduce the number
>> of
>> > > MR jobs generated. I remember Dmitriy bringing this up early. The
>> > > techniques specified in this paper (Input, Job Flow, Transit
>> > correlations)
>> > > has been patched into Hive. If Pig doesn't use these optimizations
>> then I
>> > > think it will be good to have them in Pig as well.
>> > >
>> > > Here is the link to the paper
>> > >
>> >
>> http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf
>> > >
>> > > I think this can be a good candidate project for GSoC.
>> > >
>> > > Thanks
>> > > -- Prasanth
>> > >
>> > > On Mar 21, 2013, at 3:51 PM, Olga Natkovich <[EMAIL PROTECTED]>
>> > wrote:
>> > >
>> > > > +1 on that
>> > > >
>> > > >
>> > > > ________________________________
>> > > > From: Russell Jurney <[EMAIL PROTECTED]>
>> > > > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> > > > Sent: Thursday, March 21, 2013 11:54 AM
>> > > > Subject: Re: Put a "Google summer of code 2013" cwiki page
>> > > >
>> > > > Make Grunt use Antlr - high priority one for me. Once Grunt uses
>> Antlr,
>> > > > macros will flourish.
>> > > >
>> > > >
>> > > > On Wed, Mar 20, 2013 at 6:25 PM, Daniel Dai <[EMAIL PROTECTED]>
>> > > wrote:
>> > > >
>> > > >> https://cwiki.apache.org/confluence/display/PIG/GSoc2013
>> > > >>
>> > > >> Feel free to add more project which could fit in the timeline of a
>> > > >> student summer project.
>> > > >>
>> > > >> I remember there are several projects we discussed in our last
>> meetup:
>> > > >> * Allow Pig use Hive UDFs, Alan, do we have a ticket for that?
>> > > >> * A general framework for Pig performance test, Rohini, do we have
>> a
>> > > >> ticket?
>> > > >>
>> > > >> Thanks,
>> > > >> Daniel
>> > > >>
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Russell Jurney twitter.com/rjurney [EMAIL PROTECTED]
>> > > datasyndrome.com
>> > >
>> > >
>> >
>>
>
>
+
Johnny Zhang 2013-04-24, 22:33
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB