Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> Two Problems about Running Twitter Trend Example in cluster mode


Copy link to this message
-
Two Problems about Running Twitter Trend Example in cluster mode
Hi all,

I am using zookeeper-3.3.6 (stable).
I tried to run the twitter trend example in two machines: testing.machine1
and testing.machine2.
In testing.machine1, I ran 3 zk servers, named zoo1, zoo2 and zoo3.
In testing.machine2, I ran 2 zk servers, named zoo4 and zoo5.
I was sure that the zk server cluster was set up successfully.

Then I followed the instructions step by step in the official website.
However I tried to create and deploy applications separately, but I failed
to deploy after created the applications.
The error logs are as follows.

[root@testing s4]# ./s4 deploy -appName=twitter-counter -c=cluster1
-s4r=./test-apps/twitter-counter/build/libs/twitter-counter.s4r
-zk=testing.machine1:2181
09:57:03.628 [main] ERROR org.apache.s4.tools.Deploy - Cannot deploy app
java.lang.NullPointerException: null
    at org.apache.s4.tools.Deploy.main(Deploy.java:73)
~[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.6.0_22]
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
~[na:1.6.0_22]
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.6.0_22]
    at java.lang.reflect.Method.invoke(Method.java:616) ~[na:1.6.0_22]
    at org.apache.s4.tools.Tools$Task.dispatch(Tools.java:54)
[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
    at org.apache.s4.tools.Tools.main(Tools.java:94)
[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
Then I ran the command "./s4 deploy -appName=twitter-counter -c=cluster1
-b=`pwd`/test-apps/twitter-counter/build.gradle" to create and deploy at
one step.
At this time, I succeed.
And the adapter was working properly. One of the counter applications was
working properly, however, there was always one counter applications unable
to work well.

Counter1:
11:14:23.980 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [techschool]
11:14:24.011 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Windows8yHP]
11:14:24.011 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [fiesta]
11:14:24.937 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Hola]
11:14:24.945 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [itsokay]
11:14:26.943 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Enerooooooooo!.]
11:14:26.977 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [BUnation]
11:14:28.224 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [nisekoi]
11:14:28.943 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [nobullshit]
11:14:29.210 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [somethingiwillneversay]
Counter2:
11:14:28.221 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.223 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.226 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.228 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.230 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.239 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.299 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.666 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.933 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.942 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.943 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=TopicSeen
11:14:28.947 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.955 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.990 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus

Adapter:
^C11:14:33.975 [Twitter4J Async Dispatcher[0]] DEBUG
twitter4j.StatusStreamImpl - Received:{"contributors":null,"text":"Antonio
Eduar....... juro que não, estou há 15 ano morando aqui e quando vou ao
Brasil para visitor tenho ataques de... http://t.co/XTNnYY6v
","geo":null,"retweeted":false,"in_reply_to_screen_name":null,"possibly_sensitive":false,"truncated":false,"entities":{"urls":[{"expanded_url":"
http://noticias.terra.com.br/mundo/noticias/0,,OI6318900-EI308,00-Judeus+protestam+em+SP+por+direito+de+Israel+se+defender.html
","indices":[120,140],"display_url":"
noticias.terra.com.br/mundo/noticias\u2026","url":"http://t.co/XTNnYY6v"}],"hashtags":[],"user_mentions":[]},"in_reply_to_status_id_str":null,"id":271089234113351680,"in_reply_to_user_id_str":null,"source":"<a
href=\"http://www.terra.com.br" rel=\"nofollow\">Terra
Brasil<\/a>","favorited":false,"in_reply_to_status_id":null,"created_at":"Wed
Nov 21 03:14:44 +0000
2012","retweet_count":0,"in_reply_to_user_id":null,"possibly_sensitive_editable":true,"id_str":"271089234113351680","place":null,"user":{"location":"","default_profile":true,"statuses_count":205,"profile_background_tile":false,"lang":"en","profile_link_color":"0084B4","id":500403658,"following":null,"fa