Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper >> mail # user >> Two Problems about Running Twitter Trend Example in cluster mode


Copy link to this message
-
Two Problems about Running Twitter Trend Example in cluster mode
Hi all,

I am using zookeeper-3.3.6 (stable).
I tried to run the twitter trend example in two machines: testing.machine1
and testing.machine2.
In testing.machine1, I ran 3 zk servers, named zoo1, zoo2 and zoo3.
In testing.machine2, I ran 2 zk servers, named zoo4 and zoo5.
I was sure that the zk server cluster was set up successfully.

Then I followed the instructions step by step in the official website.
However I tried to create and deploy applications separately, but I failed
to deploy after created the applications.
The error logs are as follows.

[root@testing s4]# ./s4 deploy -appName=twitter-counter -c=cluster1
-s4r=./test-apps/twitter-counter/build/libs/twitter-counter.s4r
-zk=testing.machine1:2181
09:57:03.628 [main] ERROR org.apache.s4.tools.Deploy - Cannot deploy app
java.lang.NullPointerException: null
    at org.apache.s4.tools.Deploy.main(Deploy.java:73)
~[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.6.0_22]
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
~[na:1.6.0_22]
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.6.0_22]
    at java.lang.reflect.Method.invoke(Method.java:616) ~[na:1.6.0_22]
    at org.apache.s4.tools.Tools$Task.dispatch(Tools.java:54)
[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
    at org.apache.s4.tools.Tools.main(Tools.java:94)
[s4-tools-0.5.0-incubating.jar:0.5.0-incubating]
Then I ran the command "./s4 deploy -appName=twitter-counter -c=cluster1
-b=`pwd`/test-apps/twitter-counter/build.gradle" to create and deploy at
one step.
At this time, I succeed.
And the adapter was working properly. One of the counter applications was
working properly, however, there was always one counter applications unable
to work well.

Counter1:
11:14:23.980 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [techschool]
11:14:24.011 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Windows8yHP]
11:14:24.011 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [fiesta]
11:14:24.937 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Hola]
11:14:24.945 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [itsokay]
11:14:26.943 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [Enerooooooooo!.]
11:14:26.977 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [BUnation]
11:14:28.224 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [nisekoi]
11:14:28.943 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [nobullshit]
11:14:29.210 [TopicSeen] INFO  o.a.s.e.t.TopicCountAndReportPE - Handling
new topic [somethingiwillneversay]
Counter2:
11:14:28.221 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.223 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.226 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.228 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.230 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.239 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.299 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.666 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.933 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.942 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.943 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=TopicSeen
11:14:28.947 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.955 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus
11:14:28.990 [Receiver] ERROR org.apache.s4.core.Receiver - Could not find
target stream for event with appId=-1 and streamId=RawStatus

Adapter:
^C11:14:33.975 [Twitter4J Async Dispatcher[0]] DEBUG
twitter4j.StatusStreamImpl - Received:{"contributors":null,"text":"Antonio
Eduar....... juro que não, estou há 15 ano morando aqui e quando vou ao
Brasil para visitor tenho ataques de... http://t.co/XTNnYY6v
","geo":null,"retweeted":false,"in_reply_to_screen_name":null,"possibly_sensitive":false,"truncated":false,"entities":{"urls":[{"expanded_url":"
http://noticias.terra.com.br/mundo/noticias/0,,OI6318900-EI308,00-Judeus+protestam+em+SP+por+direito+de+Israel+se+defender.html
","indices":[120,140],"display_url":"
noticias.terra.com.br/mundo/noticias\u2026","url":"http://t.co/XTNnYY6v"}],"hashtags":[],"user_mentions":[]},"in_reply_to_status_id_str":null,"id":271089234113351680,"in_reply_to_user_id_str":null,"source":"<a
href=\"http://www.terra.com.br" rel=\"nofollow\">Terra
Brasil<\/a>","favorited":false,"in_reply_to_status_id":null,"created_at":"Wed
Nov 21 03:14:44 +0000
2012","retweet_count":0,"in_reply_to_user_id":null,"possibly_sensitive_editable":true,"id_str":"271089234113351680","place":null,"user":{"location":"","default_profile":true,"statuses_count":205,"profile_background_tile":false,"lang":"en","profile_link_color":"0084B4","id":500403658,"following":null,"fa
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB