Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill >> mail # user >> Distributed mode troubles: ZK/Curator connection time out


+
Michael Hausenblas 2013-10-27, 21:00
+
Steven Phillips 2013-10-27, 21:32
+
Michael Hausenblas 2013-10-27, 21:57
+
Steven Phillips 2013-10-27, 22:17
+
Michael Hausenblas 2013-10-27, 22:39
+
Steven Phillips 2013-10-27, 22:44
+
Steven Phillips 2013-10-27, 22:48
+
Michael Hausenblas 2013-10-28, 09:42
+
Jacques Nadeau 2013-10-28, 20:15
Copy link to this message
-
Re: Distributed mode troubles: ZK/Curator connection time out

OK, thanks again re the hints for ZK and how to launch submit_plan. Now I’ve got a 'java.net.SocketException: Network is unreachable’

Background: I’ve three Drillbits running all connected to ZK:
[zk: 127.0.0.1:2181(CONNECTED) 4] ls /drill/drillbits1
[d2e9c990-1607-48f8-8d99-4a209b312a43, 17bf46c9-23f2-42cc-8d25-cc42b7a599f0, 146c8df4-a62c-41b8-af1f-0f7551867d84]
When I then submit a physical plan:

$ bin/submit_plan -f sample-data/physical_json_scan_test1.json -t physical -zk 127.0.0.1:2181

I get:

[[
Exception in thread "main" org.apache.drill.exec.rpc.RpcException: Failure connecting to server. Failure of type CONNECTION.
at org.apache.drill.exec.client.DrillClient$FutureHandler.connectionFailed(DrillClient.java:246)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:155)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:141)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:621)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:548)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:407)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.connect(AbstractNioChannel.java:217)
at io.netty.channel.DefaultChannelPipeline$HeadHandler.connect(DefaultChannelPipeline.java:1008)
at io.netty.channel.DefaultChannelHandlerContext.invokeConnect(DefaultChannelHandlerContext.java:491)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:476)
at io.netty.channel.ChannelOutboundHandlerAdapter.connect(ChannelOutboundHandlerAdapter.java:47)
at io.netty.channel.DefaultChannelHandlerContext.invokeConnect(DefaultChannelHandlerContext.java:491)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:476)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:461)
at io.netty.channel.DefaultChannelPipeline.connect(DefaultChannelPipeline.java:847)
at io.netty.channel.AbstractChannel.connect(AbstractChannel.java:198)
at io.netty.bootstrap.Bootstrap$2.run(Bootstrap.java:165)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:354)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:366)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.util.concurrent.ExecutionException: java.net.SocketException: Network is unreachable
at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:147)
... 19 more
Caused by: java.net.SocketException: Network is unreachable
at sun.nio.ch.Net.connect0(Native Method)
at sun.nio.ch.Net.connect(Net.java:364)
at sun.nio.ch.Net.connect(Net.java:356)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:623)
at io.netty.channel.socket.nio.NioSocketChannel.doConnect(NioSocketChannel.java:195)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.connect(AbstractNioChannel.java:172)
... 14 more

]]

Thoughts?
Cheers,
Michael

--
Michael Hausenblas
Ireland, Europe
http://mhausenblas.info/

On 27 Oct 2013, at 22:48, Steven Phillips <[EMAIL PROTECTED]> wrote:

> Actually, I am wrong, Drill does not start a zookeeper when running in
> local mode. The LocalClusterCoordinator does not use zookeeper at all.
>
>
> On Sun, Oct 27, 2013 at 3:44 PM, Steven Phillips <[EMAIL PROTECTED]>wrote:
>
>> Drill will start a zookeeper only in embedded mode. For example, running
>> sqlline using parquet-local will launch a drillbit and zk all within one
>> JVM.
>>
>> But to run a standalone drillbit requires an external zookeeper.
>>
>>
>> On Sun, Oct 27, 2013 at 3:39 PM, Michael Hausenblas <
+
Steven Phillips 2013-10-27, 22:35
+
Michael Hausenblas 2013-10-27, 22:42
+
Timothy Chen 2013-10-27, 21:50