Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill >> mail # user >> Distributed mode troubles: ZK/Curator connection time out


+
Michael Hausenblas 2013-10-27, 21:00
+
Steven Phillips 2013-10-27, 21:32
+
Michael Hausenblas 2013-10-27, 21:57
+
Steven Phillips 2013-10-27, 22:17
+
Michael Hausenblas 2013-10-27, 22:39
+
Steven Phillips 2013-10-27, 22:44
+
Steven Phillips 2013-10-27, 22:48
+
Michael Hausenblas 2013-10-28, 09:42
+
Jacques Nadeau 2013-10-28, 20:15
Copy link to this message
-
Re: Distributed mode troubles: ZK/Curator connection time out

OK, thanks again re the hints for ZK and how to launch submit_plan. Now I’ve got a 'java.net.SocketException: Network is unreachable’

Background: I’ve three Drillbits running all connected to ZK:
[zk: 127.0.0.1:2181(CONNECTED) 4] ls /drill/drillbits1
[d2e9c990-1607-48f8-8d99-4a209b312a43, 17bf46c9-23f2-42cc-8d25-cc42b7a599f0, 146c8df4-a62c-41b8-af1f-0f7551867d84]
When I then submit a physical plan:

$ bin/submit_plan -f sample-data/physical_json_scan_test1.json -t physical -zk 127.0.0.1:2181

I get:

[[
Exception in thread "main" org.apache.drill.exec.rpc.RpcException: Failure connecting to server. Failure of type CONNECTION.
at org.apache.drill.exec.client.DrillClient$FutureHandler.connectionFailed(DrillClient.java:246)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:155)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:141)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:621)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:548)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:407)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.connect(AbstractNioChannel.java:217)
at io.netty.channel.DefaultChannelPipeline$HeadHandler.connect(DefaultChannelPipeline.java:1008)
at io.netty.channel.DefaultChannelHandlerContext.invokeConnect(DefaultChannelHandlerContext.java:491)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:476)
at io.netty.channel.ChannelOutboundHandlerAdapter.connect(ChannelOutboundHandlerAdapter.java:47)
at io.netty.channel.DefaultChannelHandlerContext.invokeConnect(DefaultChannelHandlerContext.java:491)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:476)
at io.netty.channel.DefaultChannelHandlerContext.connect(DefaultChannelHandlerContext.java:461)
at io.netty.channel.DefaultChannelPipeline.connect(DefaultChannelPipeline.java:847)
at io.netty.channel.AbstractChannel.connect(AbstractChannel.java:198)
at io.netty.bootstrap.Bootstrap$2.run(Bootstrap.java:165)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:354)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:366)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.util.concurrent.ExecutionException: java.net.SocketException: Network is unreachable
at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37)
at org.apache.drill.exec.rpc.BasicClient$ConnectionMultiListener$ConnectionHandler.operationComplete(BasicClient.java:147)
... 19 more
Caused by: java.net.SocketException: Network is unreachable
at sun.nio.ch.Net.connect0(Native Method)
at sun.nio.ch.Net.connect(Net.java:364)
at sun.nio.ch.Net.connect(Net.java:356)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:623)
at io.netty.channel.socket.nio.NioSocketChannel.doConnect(NioSocketChannel.java:195)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.connect(AbstractNioChannel.java:172)
... 14 more

]]

Thoughts?
Cheers,
Michael

--
Michael Hausenblas
Ireland, Europe
http://mhausenblas.info/

On 27 Oct 2013, at 22:48, Steven Phillips <[EMAIL PROTECTED]> wrote:

> Actually, I am wrong, Drill does not start a zookeeper when running in
> local mode. The LocalClusterCoordinator does not use zookeeper at all.
>
>
> On Sun, Oct 27, 2013 at 3:44 PM, Steven Phillips <[EMAIL PROTECTED]>wrote:
>
>> Drill will start a zookeeper only in embedded mode. For example, running
>> sqlline using parquet-local will launch a drillbit and zk all within one
>> JVM.
>>
>> But to run a standalone drillbit requires an external zookeeper.
>>
>>
>> On Sun, Oct 27, 2013 at 3:39 PM, Michael Hausenblas <
+
Steven Phillips 2013-10-27, 22:35
+
Michael Hausenblas 2013-10-27, 22:42
+
Timothy Chen 2013-10-27, 21:50
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB