Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # dev - timeline for dist execution


Copy link to this message
-
Re: timeline for dist execution
Jacques Nadeau 2013-04-08, 16:01
Given David's request to have everybody review whatever I share, let's do
M/T/W of next week..  What times are people available?

J

On Sun, Apr 7, 2013 at 10:49 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> I'm open 2pm pst, see when Jacques is open.
>
> Tim
>
> Sent from my iPad
>
> On Apr 7, 2013, at 6:01 PM, David Alves <[EMAIL PROTECTED]> wrote:
>
> > Hi Jacques
> >
> >> I'll try to drop some of my work and thoughts on the list this week.
> >
> >    That is great news!
> >
> >> As always with these things, everything takes longer than one would
> >> like…
> >    Hopefully we can help and take of the workload.
> >
> >> I am also thinking that it might be good to do a google hangout
> >> brainstorming session soon around some of this stuff to help move
> >> things along.
> >
> >    A google hangout is a good idea.
> >    Wednesday would be a good day for me, say 2PM PST, how about for
> other people?
> >    I do think we should do it after we get a chance to take a look at
> what you already have so that we're all in the same page.
> >
> > Best
> > David
> >
> > On Apr 6, 2013, at 11:36 PM, Jacques Nadeau <[EMAIL PROTECTED]>
> wrote:
> >
> >> I'll try to drop some of my work and thoughts on the list this week.
> >> As always with these things, everything takes longer than one would
> >> like...
> >>
> >> I am also thinking that it might be good to do a google hangout
> >> brainstorming session soon around some of this stuff to help move
> >> things along.
> >>
> >> J
> >>
> >> On Apr 6, 2013, at 8:39 PM, Lisen Mu <[EMAIL PROTECTED]> wrote:
> >>
> >>> +1
> >>>
> >>> It would be nice to see what's the current status and future plan on
> in-mem
> >>> data representation in the dist exec engine.
> >>>
> >>> I was previously going to do something about DataValue in exec/ref.
> However
> >>> after some reading into previous discussions in the maillist and some
> links
> >>> in 'useful research' wiki page
> >>> (vldb09-tutorial6.pdf<http://www.vldb.org/pvldb/2/vldb09-tutorial6.pdf
> >
> >>> abadisigmod06.pdf<
> http://cs-www.cs.yale.edu/homes/dna/papers/abadisigmod06.pdf>
> >>> etc.)
> >>>
> >>> I found it non-trivial and crucial building block to build in-mem data
> >>> structure. Incremental optimisation based on current DataValue seems a
> bad
> >>> idea.
> >>>
> >>> So what's your thought on this? If we could get a sketch, I would very
> much
> >>> like to do something on this issue.
> >>>
> >>>
> >>> On Sat, Apr 6, 2013 at 6:31 AM, David Alves <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>>> Hi All
> >>>>
> >>>>      I was wondering if there is a timeline on when we might get a
> >>>> sketch of the dist execution engine.
> >>>>      As I mentioned before I have a little over a month to get
> >>>> something working and I'm starting to get a bit worried.
> >>>>      I've been working in the parallel per region hbase scanner and
> >>>> soon I'll have something usable.
> >>>>      I can definitely put in a few hours working/helping on it if that
> >>>> helps, but as previously suggested I'd rather not reinvent the wheel.
> >>>>      Right now I was thinking that something that plugs-in to the
> >>>> reference implementation (i.e. would not require a stable SE iface)
> would
> >>>> be a nice start.
> >>>>      What do you think?
> >>>>
> >>>> Best
> >>>> David
> >
>