Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> Using zookeeper in a hightly restricted (cloud) environment


Copy link to this message
-
Re: Using zookeeper in a hightly restricted (cloud) environment
Sweet. Perhaps you could update the FAQ or troubleshooting guide with
your findings (ie the problem and how you debugged/fixed it), if you
think it's appropriate?

https://cwiki.apache.org/confluence/display/ZOOKEEPER/Troubleshooting
https://cwiki.apache.org/confluence/display/ZOOKEEPER/FAQ

Patrick

On Thu, Jun 7, 2012 at 2:17 PM, David Bosschaert
<[EMAIL PROTECTED]> wrote:
> Thanks for confirming this Patrick, this helped me isolate the problem
> I was having.
> It turned out that the problem was outside of Zookeeper and I have now
> successfully been able to use Zookeeper in my environment.
>
> Thanks again,
>
> David
>
> On 30 May 2012 17:45, Patrick Hunt <[EMAIL PROTECTED]> wrote:
>> This should work fine. Notice that while the connection is established
>> the session is never established, eventually it times out.
>>
>> Have you tried running a 4 letter word and see if that at least works?
>> http://zookeeper.apache.org/doc/r3.4.3/zookeeperAdmin.html#sc_zkCommands
>> (try 'stat' for example)
>>
>> Was there anything further in the server log after the client
>> attempted to connect? There should have been a message that the client
>> was attempting to connect, if this is not the case then perhaps the
>> firewall is blocking. Try the 4lw or using telnet to verify that your
>> client can get past the firewall to the socket bound by the server.
>>
>> Patrick
>>
>> On Fri, May 25, 2012 at 2:23 PM, David Bosschaert
>> <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> I'm trying to use zookeeper in a cloud environment where I have an
>>> extremely limited set of server ports available.
>>> The setup is as follows. I want to run the ZooKeeper server inside my
>>> cloud node so that it can be accessed from outside. In the node I can
>>> open a Server Socket on an IP that looks like this 127.3.241.1:8080.
>>> Port 8080 is then only Server Port I can open, no other ServerSockets
>>> are allowed.
>>> From the outside this gets translated into some host.somedomain.com:80
>>> (port 80!).
>>>
>>> The zkServer starts up fairly happy (I set
>>> clientPortAddress=127.3.241.1 and clientPort=8080) - see the log
>>> below.
>>>
>>> However, when I start the client console
>>> $ bin/zkCli.sh -server host.somedomain.com:80
>>> it does not connect properly, and 'ls /' just hangs. I've also pasted
>>> the log below
>>>
>>> My question is: is it possible to use ZooKeeper in such a restricted
>>> environment at all? If so how should I configure it?
>>>
>>> Thanks,
>>>
>>> David
>>>
>>> Here's the server log:
>>> remote: JMX disabled by user request
>>> remote: Using config:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:54,642 [myid:] - INFO
>>> [main:QuorumPeerConfig@101] - Reading configuration from:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:54,735 [myid:] - INFO
>>> [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
>>> remote: 2012-05-25 11:11:54,736 [myid:] - INFO
>>> [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
>>> remote: 2012-05-25 11:11:54,737 [myid:] - INFO
>>> [main:DatadirCleanupManager@101] - Purge task is not scheduled.
>>> remote: 2012-05-25 11:11:54,738 [myid:] - WARN
>>> [main:QuorumPeerMain@113] - Either no config or no quorum defined in
>>> config, running  in standalone mode
>>> remote: 2012-05-25 11:11:55,053 [myid:] - INFO
>>> [main:QuorumPeerConfig@101] - Reading configuration from:
>>> /var/lib/stickshift/80d2b6413ce14d3eb25c86e33f69c275/zks1/repo/zookeeper-3.4.3/bin/../conf/zoo.cfg
>>> remote: 2012-05-25 11:11:55,054 [myid:] - INFO
>>> [main:ZooKeeperServerMain@95] - Starting server
>>> remote: 2012-05-25 11:11:55,142 [myid:] - INFO  [main:Environment@98]
>>> - Server environment:zookeeper.version=3.4.3-1240972, built on
>>> 02/06/2012 10:48 GMT
>>> remote: 2012-05-25 11:11:55,143 [myid:] - INFO  [main:Environment@98]