Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa, mail # user - problem with hadoop version2 ( IPC version 7 ) and chukwa 0.5


Copy link to this message
-
Re: problem with hadoop version2 ( IPC version 7 ) and chukwa 0.5
Farrokh Shahriari 2013-02-05, 09:33
How Can I enabled other logs ? should I config sth special or not ?

On Tue, Feb 5, 2013 at 8:55 AM, Eric Yang <[EMAIL PROTECTED]> wrote:

> Some of the logs are disabled by default because we started in Hadoop 0.16
> and haven't updated logging to Hadoop 1.x configuration.
>
> Refer to the programming guide on how to stream your custom logs to hbase:
>
> http://incubator.apache.org/chukwa/docs/r0.5.0/programming.html
>
> regards,
> Eric
>
>
> On Sun, Feb 3, 2013 at 11:37 PM, Farrokh Shahriari <
> [EMAIL PROTECTED]> wrote:
>
>> Tnx a lot Eric, Yeah yor were right,I forgot to insert this code in
>> chukwa-collector-conf.xml :
>> <property>
>>  <name>chukwaCollector.writerClass</name>
>>
>>  <value>org.apache.hadoop.chukwa.datacollection.writer.hbase.HBaseWriter</value>
>> </property>
>>
>> Now I can select the SystemMetrics and chukwa columns,but not the others
>> like : Hadoop,HadoopLog,clustersummary. Why are these table's columns
>> disbaled ? How about my own table like 'myTable' which created in Hbase ?
>>
>>
>>
>> On Sun, Feb 3, 2013 at 10:58 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>
>>> There are two possibilities.  First, HBase is not configured properly to
>>> the instance of ZooKeeper that is storing the table information.
>>>
>>> Another possibility is that hicc is not configured with HBASE_CONF_DIR
>>> to access correct ZooKeeper instance described in hbase-site.xml.
>>>
>>> After you solved the first problem, make sure that Chukwa hbase schema
>>> is populated.  This is done with:
>>>
>>>  hbase shell < $CHUKWA_CONF_DIR/hbase.schema
>>>
>>> This step is required to create Chukwa table on HBase.
>>>
>>> regards,
>>> Eric
>>>
>>>
>>> On Sun, Feb 3, 2013 at 2:12 AM, Farrokh Shahriari <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Tnx for your answer,
>>>> By your help I can now run hicc & webui, now in the graph_explorer,It
>>>> shows my table in hbase, but I can't select any of them means I can't
>>>> select any columnFamily of them,
>>>> the hicc.log says :
>>>>
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client
>>>> environment:java.library.path=/usr/lib/hadoop/lib/native/Linux-i386-32
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:java.io.tmpdir=/tmp
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:java.compiler=<NA>
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:os.name=Linux
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:os.arch=amd64
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:os.version=2.6.32-220.el6.x86_64
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:user.name=root
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:user.home=/root
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Client environment:user.dir=/etc/Chukwa/chukwa-incubating-0.5.0
>>>> 2013-02-03 13:34:09,242 INFO 819062722@qtp-651528505-7 ZooKeeper -
>>>> Initiating client connection, connectString=hadoop-standalone:2181
>>>> sessionTimeout=180000 watcher=hconnection
>>>> 2013-02-03 13:34:09,250 INFO 819062722@qtp-651528505-7-SendThread()
>>>> ClientCnxn - Opening socket connection to server /192.168.150.254:2181
>>>> 2013-02-03 13:34:09,250 INFO 819062722@qtp-651528505-7RecoverableZooKeeper - The identifier of this process is
>>>> [EMAIL PROTECTED]
>>>> 2013-02-03 13:34:09,254 WARN 819062722@qtp-651528505-7-SendThread(
>>>> hadoop-standalone.soc.net:2181) ZooKeeperSaslClient -
>>>> SecurityException: java.lang.SecurityException: Unable to locate a login
>>>> configuration occurred when trying to find JAAS configuration.
>>>> 2013-02-03 13:34:09,254 INFO 819062722@qtp-651528505-7-SendThread(
>>>> hadoop-standalone.soc.net:2181) ZooKeeperSaslClient - Client will not