Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill >> mail # dev >> sqlline broken?


+
Ted Dunning 2013-07-21, 21:32
+
Jacques Nadeau 2013-07-22, 00:18
+
Ted Dunning 2013-07-22, 02:16
+
Jacques Nadeau 2013-07-22, 01:13
+
Ted Dunning 2013-07-22, 02:17
Copy link to this message
-
Re: sqlline broken?
Yeah,  I had much the same spinning.   Looks like optiq trunk moved forward
and we need to update sqlparser to incorporate latest ops
On Jul 21, 2013 7:18 PM, "Ted Dunning" <[EMAIL PROTECTED]> wrote:

> I am going to leave these out of the workshop.
>
>
> On Sun, Jul 21, 2013 at 6:13 PM, Jacques Nadeau <[EMAIL PROTECTED]>
> wrote:
>
> > I just realized that somehow we didn't merge all of the operators from
> > Julian's branch.   Join and union are missing. You might work with the
> tip
> > of his optiq branch until we get those merged.
> > On Jul 21, 2013 5:18 PM, "Jacques Nadeau" <[EMAIL PROTECTED]> wrote:
> >
> > > maybe try with a mvn clean install and let all tests run.
> > >
> > > I did a clean checkout and query worked.
> > >
> > > Also, we haven't added syntactic sugar yet so you need to do:
> > >
> > > >>select _MAP['type'] from donuts
> > >
> > > instead of
> > >
> > > >>select type from donuts
> > >
> > >
> > > Note that you can use subqueries to clean things up a bit.
> > >
> > > SELECT ppu, count(1) AS cnt FROM
> > >   (SELECT _MAP['ppu'] AS ppu, _MAP['type'] AS type FROM donuts)y
> > > GROUP BY ppu
> > > ORDER BY ppu DESC;
> > >
> > > If I recall, Julian has worked on adding views but I don't think we
> > > have that available in Drill yet.  (Julian will be able to confirm).
> > > I also thought we had added limit but I trying it reveals it isn't in
> > > yet.
> > >
> > > Jacques
> > >
> > >
> > > On Sun, Jul 21, 2013 at 2:32 PM, Ted Dunning <[EMAIL PROTECTED]>
> > > wrote:
> > > > I am prepping for a workshop and it appears that sql line is a bit
> > > broken.
> > > >
> > > > Steps that I did:
> > > >
> > > > installed protoc 2.5.0
> > > > git pull and checkout of pre_exec_merge
> > > >
> > > >
> > > > This seems all in order.
> > > >
> > > > Then I run sqlline and connect to the donuts table which seems to
> work
> > > well
> > > > (I added a -q in sqlline to minimize mvn squawking)
> > > >
> > > > $ cd incubator-drill/sandbox/prototype
> > > > $ mvn install -DskipTests
> > > > $ rm .classpath
> > > > $ ./sqlline
> > > > /Users/tdunning/.sqlline/sqlline.properties (No such file or
> directory)
> > > > sqlline version ??? by Marc Prud'hommeaux
> > > > sqlline> !connect
> > > > jdbc:optiq:model=common/target/test-classes/donuts-model.json admin
> > admin
> > > > Connecting to
> > > jdbc:optiq:model=common/target/test-classes/donuts-model.json
> > > >  ... lots of messages about logback being configured poorly ...
> > > >
> > > > Connected to: Optiq (version 0.4.2)
> > > > Driver: Optiq JDBC Driver (version 0.4.2)
> > > > Autocommit status: true
> > > > Transaction isolation: TRANSACTION_REPEATABLE_READ
> > > >
> > > >
> > > > Here is the exciting part.  I enter a simple query:
> > > >
> > > > 0: jdbc:optiq:model=common/target/test-classe> select * from donuts;
> > > >
> > > > What pops out is a reasonable logical plan:
> > > >
> > > >     {
> > > >         "head":{
> > > >         "type":"apache_drill_logical_plan",
> > > >         "version":"1",
> > > >         "generator":{"type":"manual","info":"na"}
> > > >         },
> > > >         "storage":[
> > > >              {"name":"donuts-json","type":"classpath"},
> > > >              {"name":"queue","type":"queue"}],
> > > >         "query":[
> > > >         {"op":"sequence","do":[
> > > >
> > > >
> > >
> >
> {"op":"scan","memo":"initial_scan","ref":"_MAP","storageengine":"donuts-json","selection":{"path":"/donuts.json","type":"JSON"}},
> > > >
> > > > {"op":"project","projections":[{"expr":"_MAP","ref":"output._MAP"}]},
> > > >             {"op":"store","storageengine":"queue","memo":"output
> > > > sink","target":{"number":0}}
> > > >         ]
> > > >         }
> > > >         ]
> > > >     }
> > > >
> > > > And then problems start:
> > > >
> > > > 14:24:55.515 [main] DEBUG o.a.drill.common.config.DrillConfig -
> Loading
> > > > configs at the following URLs
> > > >
> > >
> >
> [jar:file:/Users/tdunning/.m2/repository/org/apache/drill/exec/ref/1.0-SNAPSHOT/ref-1.0-SNAPSHOT.jar!/drill-module.conf,
+
Ted Dunning 2013-07-22, 01:52
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB