Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill, mail # dev - Exception running order by in sqline


+
Timothy Chen 2013-09-04, 17:55
+
Jacques Nadeau 2013-09-04, 18:04
+
Timothy Chen 2013-09-04, 18:39
+
Jacques Nadeau 2013-09-04, 18:53
+
Ted Dunning 2013-09-04, 19:02
+
Jacques Nadeau 2013-09-04, 19:42
+
Timothy Chen 2013-09-04, 20:03
+
Timothy Chen 2013-09-04, 20:15
+
Jacques Nadeau 2013-09-04, 20:59
+
Timothy Chen 2013-09-04, 22:33
Copy link to this message
-
Re: Exception running order by in sqline
Timothy Chen 2013-09-04, 22:39
Actually picking N_NAME field works for me:

select _MAP['N_NAME'] from "sample-data/nation.parquet" order by
_MAP['N_NAME'] desc;

Running Ted's query on REGION_KEY gives me this error instead:

at org.apache.drill.exec.expr.TypeHelper.getNewVector(TypeHelper.java:504)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.setupNewSchema(ProjectRecordBatch.java:102)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:36)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.sort.SortBatch.next(SortBatch.java:86)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:25)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:77)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at org.apache.drill.exec.work.FragmentRunner.run(FragmentRunner.java:79)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
~[na:1.7.0_25]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
~[na:1.7.0_25]
at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]

Which is another problem as you can see.

Tim
On Wed, Sep 4, 2013 at 3:33 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Hi Jacques,
>
> Do you know what query with order by will work using the sample data? I'm
> trying to find one that can actually work.
>
> Tim
>
>
> On Wed, Sep 4, 2013 at 1:59 PM, Jacques Nadeau <[EMAIL PROTECTED]> wrote:
>
>> In the plan here, the problem is this:
>>
>>  { order : "asc", expr : "_MAP", nullCollation : "NULLS_LAST" }
>>
>> Two issues: there is no such thing as ordering by a map.  Additionally, we
>> don't support direct map references yet.
>>
>> What query were these plans for?  We need to make sure everybody has the
>> same expectation of output.
>>
>> J
>>
>>
>> On Wed, Sep 4, 2013 at 1:03 PM, Timothy Chen <[EMAIL PROTECTED]> wrote:
>>
>> > Just as Ted pointed out I tried just columns and ordering by different
>> > fields and none of them work.
>> >
>> > It fails on the tip of master too.
>> >
>> > Logical plan:
>> >
>> > Logical { head : { type : "APACHE_DRILL_LOGICAL", version : 1,
>> generator :
>> > { type : "optiq", info : "na" } }, storage : { parquet-local : { type :
>> > "parquet", dfsName : "file:///" } }, query : [ { op : "scan", @id : 1,
>> memo
>> > : "initial_scan", storageengine : "parquet-local", selection : [ { path
>> :
>> > "sample-data/region.parquet" } ], ref : "_MAP" }, { op : "order", @id :
>> 2,
>> > input : 1, within : null, orderings : [ { order : "asc", expr : "_MAP",
>> > nullCollation : "NULLS_LAST" } ] }, { op : "store", @id : 3, memo :
>> "output
>> > sink", input : 2, target : { number : 0 }, partition : null,
>> storageEngine
>> > : "queue" } ] }
>> >
>> > Physical plan:
>> >
>> > Physical { head : { type : "APACHE_DRILL_PHYSICAL", version : 1,
>> generator
>> > : { type : "optiq", info : "na" } }, graph : [ { pop : "parquet-scan",
>> @id
>> > : 1, entries : [ { path : "sample-data/region.parquet" } ], ref :
>> "_MAP",
>> > fragmentPointer : 0 }, { pop : "sort", @id : 2, child : 1, orderings :
>> [ {
>> > order : "asc", expr : "_MAP" } ], reverse : false }, { pop :
>> > "selection-vector-remover", @id : 3, child : 2 }, { pop : "screen", @id
>> :
>> > 4, child : 3 } ] }
>> >
>> > Tim
>> >
>> >
>> > On Wed, Sep 4, 2013 at 12:42 PM, Jacques Nadeau <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Good point.  Do you want to take a look at the plans and see what are
>> > pinch
>> > > point is?
>> > >
>> > > J
>> > > On Sep 4, 2013 12:03 PM, "Ted Dunning" <[EMAIL PROTECTED]> wrote:
>> > >
>> > > > Hmm... I don't understand the limitation.
>> > > >
>> > > > I also see these:
>> > > >
>> > > > *fails*:
>> > > >
>>
+
Jacques Nadeau 2013-09-05, 23:04
+
Timothy Chen 2013-09-06, 00:07