Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # user >> question of the installation environment chukwa


Copy link to this message
-
question of the installation environment chukwa
   Hi! I'm a chukwa user ,Recently I was configuration chukwa ,always
fail,Who can provide a list of the installation environment eg: Use what
operating system ; Use what Hadoop、HBase and Pig version ; How to set up
Time and time zone .

   According to the following log information, Can you give me some advises?
    the installation environment:Hadoop1.0.3+HBase 0.90.5+Chukwa0.5.0+Pig
0.9.2
2013-02-22 07:04:16,189 INFO btpool0-1 ZooKeeper - Initiating client
connection, connectString=dn2.dev:21818,dn1.dev:21818,hb.dev:21818
sessionTimeout=60000 watcher=hconnection
2013-02-22 07:04:16,204 INFO btpool0-1-SendThread() ClientCnxn - Opening
socket connection to server dn2.dev/192.168.13.38:21818
2013-02-22 07:04:16,206 INFO btpool0-1-SendThread(dn2.dev:21818) ClientCnxn
- Socket connection established to dn2.dev/192.168.13.38:21818, initiating
session
2013-02-22 07:04:16,216 INFO btpool0-1-SendThread(dn2.dev:21818) ClientCnxn
- Session establishment complete on server dn2.dev/192.168.13.38:21818,
sessionid = 0x23d006a2c990011, negotiated timeout = 60000
2013-02-22 07:04:21,694 WARN btpool0-1 HadoopMetricsProcessor - Wrong
format in HadoopMetricsProcessor [INFO chukwa.metrics.HadoopMetrics:
{"port":"51770","timestamp":1361516611630,"recordName":"rpc","context":"rpc","hostName":"dn1.dev","contextName":"rpc"}
]
java.text.ParseException: Unparseable date: "INFO chukwa.metrics.Ha"
    at java.text.DateFormat.parse(DateFormat.java:337)
    at
org.apache.hadoop.chukwa.extraction.demux.processor.mapper.HadoopMetricsProcessor.parse(HadoopMetricsProcessor.java:97)
    at
org.apache.hadoop.chukwa.extraction.demux.processor.mapper.AbstractProcessor.process(AbstractProcessor.java:81)
    at
org.apache.hadoop.chukwa.datacollection.writer.hbase.HBaseWriter.add(HBaseWriter.java:194)
    at
org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter.add(PipelineStageWriter.java:40)
    at
org.apache.hadoop.chukwa.datacollection.collector.servlet.ServletCollector.accept(ServletCollector.java:159)
    at
org.apache.hadoop.chukwa.datacollection.collector.servlet.ServletCollector.doPost(ServletCollector.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
    at
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
    at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
    at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
    at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
    at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
    at org.mortbay.jetty.Server.handle(Server.java:326)
    at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
    at
org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
    at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
    at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
    at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
    at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
    at
org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:451)
2013-02-22 07:04:21,724 WARN btpool0-1 HBaseWriter -
[row=dn1.dev-HadoopMetrics, families={(family=HadoopMetricsInError,
keyvalues=(dn1.dev-HadoopMetrics/HadoopMetricsInError:capp/1361516661696/Put/vlen=7,
dn1.dev-HadoopMetrics/HadoopMetricsInError:cchunkData/1361516661696/Put/vlen=232,
dn1.dev-HadoopMetrics/HadoopMetricsInError:cchunkException/1361516661696/Put/vlen=1880,
dn1.dev-HadoopMetrics/HadoopMetricsInError:csource/1361516661696/Put/vlen=7,
dn1.dev-HadoopMetrics/HadoopMetricsInError:ctags/1361516661696/Put/vlen=17)}]
2013-02-22 07:04:21,726 WARN btpool0-1 HBaseWriter -
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed
1 action: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException:
Column family HadoopMetricsInError does not exist in region
Hadoop,,1361512768478.b73e61dc5af76e9ce6283b43ded8713b. in table {NAME =>
'Hadoop', FAMILIES => [{NAME => 'ClientTrace', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '65535', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'dfs_FSNamesystem', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '65535', TTL
=> '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}, {NAME => 'dfs_datanode', BLOOMFILTER => 'NONE', REPLICATION_SCOPE
=> '0', COMPRESSION => 'NONE', VERSIONS => '65535', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
'dfs_namenode', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0',
COMPRESSION => 'NONE', VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE
=> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
'jvm_metrics', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION
=> 'NONE', VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'mapred_Queue',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE',
VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY
=> 'false', BLOCKCACHE => 'true'}, {NAME => 'mapred_jobtracker',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE',
VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY
=> 'false', BLOCKCACHE => 'true'}, {NAME => 'mapred_shuffleOutput',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE',
VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY
=> 'false', BLOCKCACHE => 'true'}, {NAME => 'mapred_tasktracker',
BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE',
VERSIONS => '65535', TTL => '2147483647', BLOCKSIZE => '65536', IN_M