Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill >> mail # dev >> facebook presto SQL query engine


Copy link to this message
-
Re: facebook presto SQL query engine
I hope to look at it soon.  If I'm able to, I'll post back anything I learn.

Jacques
On Wed, Nov 6, 2013 at 1:13 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Yes as for internals they don't really say much, but they say a lot more in
> their blog post.
>
> Looks like they have their own ByteCode generation package, I don't believe
> they have a columnar format or vectorization.
>
> Tim
>
>
> On Wed, Nov 6, 2013 at 12:52 PM, Jason Altekruse
> <[EMAIL PROTECTED]>wrote:
>
> > I thought the docs were very sparse, especially from a development
> > perspective. I was wondering if they were using vectorization or doing
> > record materialization at read time like Impala. Can't imagine they would
> > get any performance out of it if they didn't do vectorization, as they
> > already have to live within the constraints of java. Would also be
> > interesting to see if they used code generation or the netty/unsafe APIs
> at
> > all. Will be taking a closer look in the next few weeks to see if there
> are
> > some good ideas we can incorporate into Drill.
> >
> > -Jason
> >
> >
> > On Wed, Nov 6, 2013 at 1:24 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:
> >
> > > I've been waiting for this since their data conference earlier this
> year
> > :)
> > >
> > > The concepts and architecture diagram also resembles like Drill, and
> also
> > > is developed in Java.
> > >
> > > I do like their docs that lists the functions available and high level
> > > diagrams:
> > >
> > > http://prestodb.io/docs/current/
> > >
> > > Tim
> > >
> > >
> > >
> > >
> > > On Wed, Nov 6, 2013 at 11:08 AM, Jason Altekruse
> > > <[EMAIL PROTECTED]>wrote:
> > >
> > > > Facebook has been working internally on a Java based distributed SQL
> > > engine
> > > > for the past year, today they open sourced it. Here is the official
> > > > announcement:
> > > >
> > > >
> > > >
> > >
> >
> https://www.facebook.com/notes/facebook-engineering/presto-interacting-with-petabytes-of-data-at-facebook/10151786197628920
> > > >
> > > > -Jason
> > > >
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB