Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill >> mail # dev >> Exception running order by in sqline


+
Timothy Chen 2013-09-04, 17:55
+
Jacques Nadeau 2013-09-04, 18:04
+
Timothy Chen 2013-09-04, 18:39
+
Jacques Nadeau 2013-09-04, 18:53
+
Ted Dunning 2013-09-04, 19:02
+
Jacques Nadeau 2013-09-04, 19:42
+
Timothy Chen 2013-09-04, 20:03
+
Timothy Chen 2013-09-04, 20:15
+
Jacques Nadeau 2013-09-04, 20:59
+
Timothy Chen 2013-09-04, 22:33
Copy link to this message
-
Re: Exception running order by in sqline
Actually picking N_NAME field works for me:

select _MAP['N_NAME'] from "sample-data/nation.parquet" order by
_MAP['N_NAME'] desc;

Running Ted's query on REGION_KEY gives me this error instead:

at org.apache.drill.exec.expr.TypeHelper.getNewVector(TypeHelper.java:504)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.setupNewSchema(ProjectRecordBatch.java:102)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:36)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.sort.SortBatch.next(SortBatch.java:86)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:25)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:77)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.drill.exec.work.FragmentRunner.run(FragmentRunner.java:79)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
~[na:1.7.0_25]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
~[na:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]

Which is another problem as you can see.

Tim
On Wed, Sep 4, 2013 at 3:33 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Hi Jacques,
>
> Do you know what query with order by will work using the sample data? I'm
> trying to find one that can actually work.
>
> Tim
>
>
> On Wed, Sep 4, 2013 at 1:59 PM, Jacques Nadeau <[EMAIL PROTECTED]> wrote:
>
>> In the plan here, the problem is this:
>>
>>  { order : "asc", expr : "_MAP", nullCollation : "NULLS_LAST" }
>>
>> Two issues: there is no such thing as ordering by a map.  Additionally, we
>> don't support direct map references yet.
>>
>> What query were these plans for?  We need to make sure everybody has the
>> same expectation of output.
>>
>> J
>>
>>
>> On Wed, Sep 4, 2013 at 1:03 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:
>>
>> > Just as Ted pointed out I tried just columns and ordering by different
>> > fields and none of them work.
>> >
>> > It fails on the tip of master too.
>> >
>> > Logical plan:
>> >
>> > Logical { head : { type : "APACHE_DRILL_LOGICAL", version : 1,
>> generator :
>> > { type : "optiq", info : "na" } }, storage : { parquet-local : { type :
>> > "parquet", dfsName : "file:///" } }, query : [ { op : "scan", @id : 1,
>> memo
>> > : "initial_scan", storageengine : "parquet-local", selection : [ { path
>> :
>> > "sample-data/region.parquet" } ], ref : "_MAP" }, { op : "order", @id :
>> 2,
>> > input : 1, within : null, orderings : [ { order : "asc", expr : "_MAP",
>> > nullCollation : "NULLS_LAST" } ] }, { op : "store", @id : 3, memo :
>> "output
>> > sink", input : 2, target : { number : 0 }, partition : null,
>> storageEngine
>> > : "queue" } ] }
>> >
>> > Physical plan:
>> >
>> > Physical { head : { type : "APACHE_DRILL_PHYSICAL", version : 1,
>> generator
>> > : { type : "optiq", info : "na" } }, graph : [ { pop : "parquet-scan",
>> @id
>> > : 1, entries : [ { path : "sample-data/region.parquet" } ], ref :
>> "_MAP",
>> > fragmentPointer : 0 }, { pop : "sort", @id : 2, child : 1, orderings :
>> [ {
>> > order : "asc", expr : "_MAP" } ], reverse : false }, { pop :
>> > "selection-vector-remover", @id : 3, child : 2 }, { pop : "screen", @id
>> :
>> > 4, child : 3 } ] }
>> >
>> > Tim
>> >
>> >
>> > On Wed, Sep 4, 2013 at 12:42 PM, Jacques Nadeau <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Good point.  Do you want to take a look at the plans and see what are
>> > pinch
>> > > point is?
>> > >
>> > > J
>> > > On Sep 4, 2013 12:03 PM, "Ted Dunning" <[EMAIL PROTECTED]> wrote:
>> > >
>> > > > Hmm... I don't understand the limitation.
>> > > >
>> > > > I also see these:
>> > > >
>> > > > *fails*:
>> > > >
>>
+
Jacques Nadeau 2013-09-05, 23:04
+
Timothy Chen 2013-09-06, 00:07
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB