Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> Using zookeeper in a hightly restricted (cloud) environment


Copy link to this message
-
Re: Using zookeeper in a hightly restricted (cloud) environment
Sweet. Perhaps you could update the FAQ or troubleshooting guide with
your findings (ie the problem and how you debugged/fixed it), if you
think it's appropriate?

https://cwiki.apache.org/confluence/display/ZOOKEEPER/Troubleshooting
https://cwiki.apache.org/confluence/display/ZOOKEEPER/FAQ

Patrick

On Thu, Jun 7, 2012 at 2:17 PM, David Bosschaert
<[EMAIL PROTECTED]> wrote:
> Thanks for confirming this Patrick, this helped me isolate the problem
> I was having.
> It turned out that the problem was outside of Zookeeper and I have now
> successfully been able to use Zookeeper in my environment.
>
> Thanks again,
>
> David
>
> On 30 May 2012 17:45, Patrick Hunt <[EMAIL PROTECTED]> wrote:
>> This should work fine. Notice that while the connection is established
>> the session is never established, eventually it times out.
>>
>> Have you tried running a 4 letter word and see if that at least works?
>> http://zookeeper.apache.org/doc/r3.4.3/zookeeperAdmin.html#sc_zkCommands
>> (try 'stat' for example)
>>
>> Was there anything further in the server log after the client
>> attempted to connect? There should have been a message that the client
>> was attempting to connect, if this is not the case then perhaps the
>> firewall is blocking. Try the 4lw or using telnet to verify that your
>> client can get past the firewall to the socket bound by the server.
>>
>> Patrick
>>
>> On Fri, May 25, 2012 at 2:23 PM, David Bosschaert
>> <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> I'm trying to use zookeeper in a cloud environment where I have an
>>> extremely limited set of server ports available.
>>> The setup is as follows. I want to run the ZooKeeper server inside my
>>> cloud node so that it can be accessed from outside. In the node I can
>>> open a Server Socket on an IP that looks like this 127.3.241.1:8080.
>>> Port 8080 is then only Server Port I can open, no other ServerSockets
>>> are allowed.
>>> From the outside this gets translated into some host.somedomain.com:80
>>> (port 80!).
>>>
>>> The zkServer starts up fairly happy (I set
>>> clientPortAddress=127.3.241.1 and clientPort=8080) - see the log
>>> below.
>>>
>>> However, when I start the client console
>>> $ bin/zkCli.sh -server host.somedomain.com:80
>>> it does not connect properly, and 'ls /' just hangs. I've also pasted
>>> the log below
>>>
>>> My question is: is it possible to use ZooKeeper in such a restricted
>>> environment at all? If so how should I configure it?
>>>
>>> Thanks,
>>>
>>> David
>>>
>>> Here's the server log:
>>> remote: JMX disabled by user request
>>> remote: Using config:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:54,642 [myid:] - INFO
>>> [main:QuorumPeerConfig@101] - Reading configuration from:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:54,735 [myid:] - INFO
>>> [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>>> remote: 2012-05-25 11:11:54,736 [myid:] - INFO
>>> [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>> remote: 2012-05-25 11:11:54,737 [myid:] - INFO
>>> [main:DatadirCleanupManager@101] - Purge task is not scheduled.
>>> remote: 2012-05-25 11:11:54,738 [myid:] - WARN
>>> [main:QuorumPeerMain@113] - Either no config or no quorum defined in
>>> config, running  in standalone mode
>>> remote: 2012-05-25 11:11:55,053 [myid:] - INFO
>>> [main:QuorumPeerConfig@101] - Reading configuration from:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:55,054 [myid:] - INFO
>>> [main:ZooKeeperServerMain@95] - Starting server
>>> remote: 2012-05-25 11:11:55,142 [myid:] - INFO  [main:Environment@98]
>>> - Server environment:zookeeper.version=3.4.3-1240972, built on
>>> 02/06/2012 10:48 GMT
>>> remote: 2012-05-25 11:11:55,143 [myid:] - INFO  [main:Environment@98]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB