Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # user - How connect  Drill  with HDFS


Copy link to this message
-
Re: How connect Drill with HDFS
Jacques Nadeau 2013-12-06, 15:21
The message isn't DrillClient > DrillBit.  Its Drillbit > HDFS.  If looks
like you're trying to connect to an incompatible HDFS cluster with the HDFS
version that comes prepackaged with Drill.  I believe the current Drill
package is Hadoop ~1.10.  If you're running something like Hadoop2, you can
try to switch out the Hadoop jars in the Drill lib directory and see what
happens.  Since the first milestone of Drill came out before the GA release
of Hadoop 2 (2.10 I believe), we didn't include that in the libs.
 Additionally, it would be good if you filed a JIRA so that Drill can
support a Hadoop2 build profile.  For future reference, what version of
HDFS are you running?

Jacques
On Fri, Dec 6, 2013 at 7:10 AM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Have you tried to run without your changes?
>
> It seems like it can't even connect to the drillbit in the first place.
>
> Tim
>
> Sent from my iPhone
>
> > On Dec 6, 2013, at 1:38 AM, Rajika Kumarasiri <
> [EMAIL PROTECTED]> wrote:
> >
> > According to the log it means it's a client compatibility issue.
> >
> > Rajika
> >
> >
> > On Fri, Dec 6, 2013 at 4:32 AM, Michael Hausenblas <
> > [EMAIL PROTECTED]> wrote:
> >
> >>
> >> Thank you, Guo Ying. I must admit that I’ve not seen this one before but
> >> I’d expect that Jason would have an idea … let’s see when the West
> coast of
> >> the US and A wakes up ;)
> >>
> >> Cheers,
> >>                Michael
> >>
> >> --
> >> Michael Hausenblas
> >> Ireland, Europe
> >> http://mhausenblas.info/
> >>
> >>> On 6 Dec 2013, at 09:27, Guo, Ying Y <[EMAIL PROTECTED]> wrote:
> >>>
> >>> Hi Michael,
> >>>      Thanks for your reply!
> >>> The errors are:
> >>> |-ERROR in ch.qos.logback.core.joran.spi.Interpreter@33:27 - no
> >> applicable action for [level], current ElementPath  is
> >> [[configuration][appender][level]]
> >>>
> >>> Error: Failure trying to connect to Drill. (state=,code=0)
> >>> java.sql.SQLException: Failure trying to connect to Drill.
> >>>       at
> >>
> org.apache.drill.jdbc.DrillHandler.onConnectionInit(DrillHandler.java:131)
> >>>       at
> >>
> net.hydromatic.optiq.jdbc.UnregisteredDriver.connect(UnregisteredDriver.java:127)
> >>>       at sqlline.SqlLine$DatabaseConnection.connect(SqlLine.java:4802)
> >>>       at
> >> sqlline.SqlLine$DatabaseConnection.getConnection(SqlLine.java:4853)
> >>>       at sqlline.SqlLine$Commands.connect(SqlLine.java:4094)
> >>>       at sqlline.SqlLine$Commands.connect(SqlLine.java:4003)
> >>>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>>       at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >>>       at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>>       at java.lang.reflect.Method.invoke(Method.java:606)
> >>>       at
> >> sqlline.SqlLine$ReflectiveCommandHandler.execute(SqlLine.java:2964)
> >>>       at sqlline.SqlLine.dispatch(SqlLine.java:878)
> >>>       at sqlline.SqlLine.initArgs(SqlLine.java:652)
> >>>       at sqlline.SqlLine.begin(SqlLine.java:699)
> >>>       at sqlline.SqlLine.mainWithInputRedirection(SqlLine.java:460)
> >>>       at sqlline.SqlLine.main(SqlLine.java:443)
> >>> Caused by: org.apache.drill.exec.exception.SetupException: Failure
> >> setting up new storage engine configuration for config
> >> org.apache.drill.exec.store.parquet.ParquetStorageEngineConfig@617e8cc0
> >>>       at
> >>
> org.apache.drill.exec.store.SchemaProviderRegistry.getSchemaProvider(SchemaProviderRegistry.java:76)
> >>>       at
> >>
> org.apache.drill.jdbc.DrillHandler.onConnectionInit(DrillHandler.java:116)
> >>>       ... 15 more
> >>> Caused by: java.lang.RuntimeException: Error setting up filesystem
> >>>       at
> >>
> org.apache.drill.exec.store.parquet.ParquetSchemaProvider.<init>(ParquetSchemaProvider.java:49)
> >>>       at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> >> Method)
> >>>       at
> >>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)