Chukwa, mail # user - Re: About the hicc start in eclipse

About the hicc start in eclipse

RainerDun 2012-06-18, 14:25

hello :

  I just started learning chukwa, and i want to build the chukwa source
code in eclipse ,but when i run the
org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
appeared some the following error tips:

12/06/18 21:01:34 INFO conf.ChukwaConfiguration:
chukwaConfis /home/rainerdun/project/chukwa-0.5.0/conf
12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
12/06/18 21:01:35 INFO
hicc.HiccWebServer:file:/home/rainerdun/workspace/chukwa-0.5.0/bin/descriptors
12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
configuration in chukwa-env.sh.
12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
directory: /home/rainerdun/project/chukwa-0.5.0/var/run/hicc.pid
12/06/18 21:01:35 ERROR util.PidFile: Delete pid
filefailed, /home/rainerdun/project/chukwa-0.5.0/var/run/hicc.pid

In getResourceListing("descriptors") method :
public List<String> getResourceListing(String path) throws
URISyntaxException, IOException {
   ClassLoader contextClassLoader Thread.currentThread().getContextClassLoader();

   URL dirURL = contextClassLoader.getResource(path);

   if (dirURL == null) {
   dirURL = contextClassLoader.getResource(path);

   }
   if (dirURL.getProtocol().equals("jar")) {
   .....

   }

Call dirURL.getProtocol()，My result is 'file',but not 'jar' 。i don't
know how and which this 'jar' to load to the classpath in the if
condition(dirURL.getProtocol().equals("jar")），.but for the error
tips, i have already set the parameter as the according to the official
document。so please tell me some advices about this problem 。very
appreciated...

About the hicc start in eclipse

RainerDun 2012-06-18, 14:02

hello :
  I just started learning chukwa, and i want to build the chukwa source
code in eclipse ,but when i run the
org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
appeared some the following error tips:
12/06/18 21:01:34 INFO conf.ChukwaConfiguration: chukwaConf
is /home/rainerdun/project/chukwa-incubating-0.5.0/etc/chukwa/
12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
12/06/18 21:01:35 INFO hicc.HiccWebServer:
file:/home/rainerdun/workspace/chukwa-0.5/bin/descriptors
12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
configuration in chukwa-env.sh.
12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
directory: /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
12/06/18 21:01:35 ERROR util.PidFile: Delete pid file
failed, /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid

In getResourceListing("descriptors") method
public List<String> getResourceListing(String path) throws
URISyntaxException, IOException {
   ClassLoader contextClassLoader Thread.currentThread().getContextClassLoader();

   URL dirURL = contextClassLoader.getResource(path);

   if (dirURL == null) {
   dirURL = contextClassLoader.getResource(path);

   }
   if (dirURL.getProtocol().equals("jar")) {
   .....

   }

Call dirURL.getProtocol()，My result is 'file',but not 'jar' 。i don't
know how and which this 'jar' to load to the classpath in the if
condition(dirURL.getProtocol().equals("jar")），.but for the error
tips, i have already set the parameter as the according to the official
document。so please tell me some advices about this problem 。very
appreciated...

Re: About the hicc start in eclipse

Ahmed Fathalla 2012-06-18, 18:15

Are you sure you configured HDFS correctly sa mentioned in the
documentation?

On Mon, Jun 18, 2012 at 4:02 PM, RainerDun <[EMAIL PROTECTED]> wrote:

> hello :
> I just started learning chukwa, and i want to build the chukwa source
> code in eclipse ,but when i run the
> org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
> appeared some the following error tips:
> 12/06/18 21:01:34 INFO conf.ChukwaConfiguration: chukwaConf
> is /home/rainerdun/project/chukwa-incubating-0.5.0/etc/chukwa/
> 12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
> 12/06/18 21:01:35 INFO hicc.HiccWebServer:
> file:/home/rainerdun/workspace/chukwa-0.5/bin/descriptors
> 12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
> configuration in chukwa-env.sh.
> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
> directory: /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file
> failed, /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
>
> In getResourceListing("descriptors") method
> public List<String> getResourceListing(String path) throws
> URISyntaxException, IOException {
> ClassLoader contextClassLoader > Thread.currentThread().getContextClassLoader();
>
> URL dirURL = contextClassLoader.getResource(path);
>
> if (dirURL == null) {
> dirURL = contextClassLoader.getResource(path);
>
> }
> if (dirURL.getProtocol().equals("jar")) {
> .....
>
> }
>
> Call dirURL.getProtocol()，My result is 'file',but not 'jar' ��i don't
> know how and which this 'jar' to load to the classpath in the if
> condition(dirURL.getProtocol().equals("jar")），.but for the error
> tips, i have already set the parameter as the according to the official
> document。so please tell me some advices about this problem ��very
> appreciated...
>
>
--
Ahmed Fathalla

Re: About the hicc start in eclipse

Eric Yang 2012-06-18, 20:13

Hi Rainer,

Make sure that HADOOP_CONF_DIR is on the classpath of the run configuration.

regards,
Eric

On Mon, Jun 18, 2012 at 11:15 AM, Ahmed Fathalla <[EMAIL PROTECTED]> wrote:
> Are you sure you configured HDFS correctly sa mentioned in the
> documentation?
>
>
> On Mon, Jun 18, 2012 at 4:02 PM, RainerDun <[EMAIL PROTECTED]> wrote:
>>
>> hello :
>> I just started learning chukwa, and i want to build the chukwa source
>> code in eclipse ,but when i run the
>> org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
>> appeared some the following error tips:
>> 12/06/18 21:01:34 INFO conf.ChukwaConfiguration: chukwaConf
>> is /home/rainerdun/project/chukwa-incubating-0.5.0/etc/chukwa/
>> 12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
>> 12/06/18 21:01:35 INFO hicc.HiccWebServer:
>> file:/home/rainerdun/workspace/chukwa-0.5/bin/descriptors
>> 12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
>> configuration in chukwa-env.sh.
>> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
>> directory:
>> /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
>> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file
>> failed, /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
>>
>> In getResourceListing("descriptors") method
>> public List<String> getResourceListing(String path) throws
>> URISyntaxException, IOException {
>> ClassLoader contextClassLoader >> Thread.currentThread().getContextClassLoader();
>>
>> URL dirURL = contextClassLoader.getResource(path);
>>
>> if (dirURL == null) {
>> dirURL = contextClassLoader.getResource(path);
>>
>> }
>> if (dirURL.getProtocol().equals("jar")) {
>> .....
>>
>> }
>>
>> Call dirURL.getProtocol()，My result is 'file',but not 'jar' ��i don't
>> know how and which this 'jar' to load to the classpath in the if
>> condition(dirURL.getProtocol().equals("jar")），.but for the error
>> tips, i have already set the parameter as the according to the official
>> document。so please tell me some advices about this problem ��very
>> appreciated...
>>
>
>
>
> --
> Ahmed Fathalla

Re: About the hicc start in eclipse

mason deng 2012-06-19, 06:31

Thank you for your reply.
   About the HADOOP_CONF_DIR . I have already set in the /etc/profile and
chukwa-env.sh. I Re-add the following statement in this Class to load the
  chukwa-env.sh：

   chukwaConf.addResource(new
Path("/home/rainerdun/project/chukwa-0.5.0/conf"));

   And now i can get the chukwaHdfs="hdfs://localhost:9000" from
config.get("fs.default.name") method .but in the if
(dirURL.getProtocol().equals("jar")) statement . still can not load the jar
file. I do not know how to produce this jar file 。
  can you tell me some details about this jar file? Thanks again。

On Tue, Jun 19, 2012 at 4:13 AM, Eric Yang <[EMAIL PROTECTED]> wrote:

> Hi Rainer,
>
> Make sure that HADOOP_CONF_DIR is on the classpath of the run
> configuration.
>
> regards,
> Eric
>
> On Mon, Jun 18, 2012 at 11:15 AM, Ahmed Fathalla <[EMAIL PROTECTED]>
> wrote:
> > Are you sure you configured HDFS correctly sa mentioned in the
> > documentation?
> >
> >
> > On Mon, Jun 18, 2012 at 4:02 PM, RainerDun <[EMAIL PROTECTED]> wrote:
> >>
> >> hello :
> >> I just started learning chukwa, and i want to build the chukwa source
> >> code in eclipse ,but when i run the
> >> org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
> >> appeared some the following error tips:
> >> 12/06/18 21:01:34 INFO conf.ChukwaConfiguration: chukwaConf
> >> is /home/rainerdun/project/chukwa-incubating-0.5.0/etc/chukwa/
> >> 12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
> >> 12/06/18 21:01:35 INFO hicc.HiccWebServer:
> >> file:/home/rainerdun/workspace/chukwa-0.5/bin/descriptors
> >> 12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
> >> configuration in chukwa-env.sh.
> >> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
> >> directory:
> >> /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
> >> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file
> >> failed, /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
> >>
> >> In getResourceListing("descriptors") method
> >> public List<String> getResourceListing(String path) throws
> >> URISyntaxException, IOException {
> >> ClassLoader contextClassLoader > >> Thread.currentThread().getContextClassLoader();
> >>
> >> URL dirURL = contextClassLoader.getResource(path);
> >>
> >> if (dirURL == null) {
> >> dirURL = contextClassLoader.getResource(path);
> >>
> >> }
> >> if (dirURL.getProtocol().equals("jar")) {
> >> .....
> >>
> >> }
> >>
> >> Call dirURL.getProtocol()，My result is 'file',but not 'jar' �
� don't
> >> know how and which this 'jar' to load to the classpath in the if
> >> condition(dirURL.getProtocol().equals("jar")），.but for the error
> >> tips, i have already set the parameter as the according to the official
> >> document。so please tell me some advices about this problem 。very
> >> appreciated...
> >>
> >
> >
> >
> > --
> > Ahmed Fathalla
>

--
这个世界不相信眼泪

Re: About the hicc start in eclipse

Eric Yang 2012-06-20, 05:48

Hi Mason,

It looks like you are manually loading chukwaConf.addResource(new
Path(...)), this should not be necessary. Instead, you might want to
do something like:

export CLASSPATH=${CLASSPATH}:/home/rainerdun/project/chukwa-0.5.0/conf
in chukwa-env.sh

This should enable to load Hadoop configuration from classpath without
having to explicitly addResource in java code. addResource should
refer to a .xml file rather than a directory. Hope this helps.

regards,
Eric

On Mon, Jun 18, 2012 at 11:31 PM, mason deng <[EMAIL PROTECTED]> wrote:
> Thank you for your reply.
> About the HADOOP_CONF_DIR . I have already set in the /etc/profile and
> chukwa-env.sh. I Re-add the following statement in this Class to load the
> chukwa-env.sh：
>
> chukwaConf.addResource(new
> Path("/home/rainerdun/project/chukwa-0.5.0/conf"));
>
> And now i can get the chukwaHdfs="hdfs://localhost:9000" from
> config.get("fs.default.name") method .but in the if
> (dirURL.getProtocol().equals("jar")) statement . still can not load the jar
> file. I do not know how to produce this jar file 。
> can you tell me some details about this jar file? Thanks again。
>
> On Tue, Jun 19, 2012 at 4:13 AM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>
>> Hi Rainer,
>>
>> Make sure that HADOOP_CONF_DIR is on the classpath of the run
>> configuration.
>>
>> regards,
>> Eric
>>
>> On Mon, Jun 18, 2012 at 11:15 AM, Ahmed Fathalla <[EMAIL PROTECTED]>
>> wrote:
>> > Are you sure you configured HDFS correctly sa mentioned in the
>> > documentation?
>> >
>> >
>> > On Mon, Jun 18, 2012 at 4:02 PM, RainerDun <[EMAIL PROTECTED]> wrote:
>> >>
>> >> hello :
>> >> I just started learning chukwa, and i want to build the chukwa source
>> >> code in eclipse ,but when i run the
>> >> org.apache.hadoop.chukwa.hicc.HiccWebServer to start the hicc service .
>> >> appeared some the following error tips:
>> >> 12/06/18 21:01:34 INFO conf.ChukwaConfiguration: chukwaConf
>> >> is /home/rainerdun/project/chukwa-incubating-0.5.0/etc/chukwa/
>> >> 12/06/18 21:01:35 INFO hicc.HiccWebServer: Initializing HICC Datastore.
>> >> 12/06/18 21:01:35 INFO hicc.HiccWebServer:
>> >> file:/home/rainerdun/workspace/chukwa-0.5/bin/descriptors
>> >> 12/06/18 21:01:35 ERROR hicc.HiccWebServer: HDFS unavailable, check
>> >> configuration in chukwa-env.sh.
>> >> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file, No such file or
>> >> directory:
>> >> /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
>> >> 12/06/18 21:01:35 ERROR util.PidFile: Delete pid file
>> >> failed,
>> >> /home/rainerdun/project/chukwa-incubating-0.5.0/var/run/hicc.pid
>> >>
>> >> In getResourceListing("descriptors") method
>> >> public List<String> getResourceListing(String path) throws
>> >> URISyntaxException, IOException {
>> >> ClassLoader contextClassLoader >> >> Thread.currentThread().getContextClassLoader();
>> >>
>> >> URL dirURL = contextClassLoader.getResource(path);
>> >>
>> >> if (dirURL == null) {
>> >> dirURL = contextClassLoader.getResource(path);
>> >>
>> >> }
>> >> if (dirURL.getProtocol().equals("jar")) {
>> >> .....
>> >>
>> >> }
>> >>
>> >> Call dirURL.getProtocol()，My result is 'file',but not 'jar' �
� don't
>> >> know how and which this 'jar' to load to the classpath in the if
>> >> condition(dirURL.getProtocol().equals("jar")），.but for the error
>> >> tips, i have already set the parameter as the according to the
>> >> official
>> >> document。so please tell me some advices about this problem �
�ery
>> >> appreciated...
>> >>
>> >
>> >
>> >
>> > --
>> > Ahmed Fathalla
>
>
>
>
> --
> 这个世界不相信眼泪

Re: About the hicc start in eclipse

mason deng 2012-06-20, 14:04

hi ,Eric:

* thanks. you are right ,there must be a .xml file rather
than a directory. and i have already set it according to your instructions
. now the question is that the *config.get("fs.default.name")
result *is null. Actually,
**even if **when i* manually loading config.get("fs.default.name")*
**=hdfs://localhost:9000.
**just only create a /chukwa/hicc/widgets empty directory *structure* on
the hdfs ，and did not upload the “descriptors” file to hdfs。*
* the key is why unable to find the jar file in the classpath of the
current。*
* This is my chukwa-env.sh*
export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21

#export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf

#export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf

export
CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/conf:/home/rainerdun/project/hadoop-1.0.0/conf
# The location of chukwa data repository (in either HDFS or your local
# file system, whichever you are using)
export chukwaRecordsRepository="/chukwa/repos/"

# The directory where pid files are stored. CHUKWA_HOME/var/run by default.
#export CHUKWA_PID_DIR=/tmp/chukwa/pidDir

# The location of chukwa logs, defaults to CHUKWA_HOME/logs
#export CHUKWA_LOG_DIR=/tmp/chukwa/log

# The location to store chukwa data, defaults to CHUKWA_HOME/data
#export CHUKWA_DATA_DIR="${CHUKWA_HOME}/data"

# Instance name for chukwa deployment
export CHUKWA_IDENT_STRING=$USER

export JAVA_PLATFORM=Linux-i386-32
export JAVA_LIBRARY_PATH=${HADOOP_HOME}/lib/native/${JAVA_PLATFORM}

# Datatbase driver name for storing Chukwa Data.
export JDBC_DRIVER=${TODO_CHUKWA_JDBC_DRIVER}

# Database URL prefix for Database Loader.
export JDBC_URL_PREFIX=${TODO_CHUKWA_JDBC_URL_PREFIX}

# HICC Jetty Server heap memory settings
# Specify min and max size of heap to JVM, e.g. 300M
export CHUKWA_HICC_MIN_MEMexport CHUKWA_HICC_MAX_MEM
# HICC Jetty Server port, defaults to 4080
#export CHUKWA_HICC_PORT
   core-site.xml file

<configuration>
   <property>
   <name>fs.default.name</name>
   <value>hdfs://localhost:9000</value>
   </property>
</configuration>
   and chukwa-collector-conf.xml file
   ......

<property>
   <name>writer.hdfs.filesystem</name>
   <value>hdfs://localhost:9000</value>
   <description>HDFS to dump to</description>
  </property>
......
*
*
* Best Regards*
* Mason*

Re: About the hicc start in eclipse

Eric Yang 2012-06-21, 05:29

If you are running this in eclipse, chukwa-env.sh is not executed.
Therefore you should defined all environment declared in chukwa-env.sh
in environment variables in eclipse run configuration.

regards,
Eric

On Wed, Jun 20, 2012 at 7:04 AM, mason deng <[EMAIL PROTECTED]> wrote:
> hi ,Eric:
>
> thanks. you are right ,there must be a .xml file rather
> than a directory. and i have already set it according to your instructions
> . now the question is that the config.get("fs.default.name") result
> is null. Actually, even if when i manually
> loading config.get("fs.default.name") =hdfs://localhost:9000. just only
> create a /chukwa/hicc/widgets empty directory structure on the hdfs ，and
> did not upload the "descriptors" file to hdfs。
> the key is why unable to find the jar file in the classpath of the
> current。
> This is my chukwa-env.sh
>
>
> export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21
>
> #export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
> export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf
>
> #export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
> export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf
>
> export
> CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/conf:/home/rainerdun/project/hadoop-1.0.0/conf
> # The location of chukwa data repository (in either HDFS or your local
> # file system, whichever you are using)
> export chukwaRecordsRepository="/chukwa/repos/"
>
> # The directory where pid files are stored. CHUKWA_HOME/var/run by default.
> #export CHUKWA_PID_DIR=/tmp/chukwa/pidDir
>
> # The location of chukwa logs, defaults to CHUKWA_HOME/logs
> #export CHUKWA_LOG_DIR=/tmp/chukwa/log
>
> # The location to store chukwa data, defaults to CHUKWA_HOME/data
> #export CHUKWA_DATA_DIR="${CHUKWA_HOME}/data"
>
> # Instance name for chukwa deployment
> export CHUKWA_IDENT_STRING=$USER
>
> export JAVA_PLATFORM=Linux-i386-32
> export JAVA_LIBRARY_PATH=${HADOOP_HOME}/lib/native/${JAVA_PLATFORM}
>
> # Datatbase driver name for storing Chukwa Data.
> export JDBC_DRIVER=${TODO_CHUKWA_JDBC_DRIVER}
>
> # Database URL prefix for Database Loader.
> export JDBC_URL_PREFIX=${TODO_CHUKWA_JDBC_URL_PREFIX}
>
> # HICC Jetty Server heap memory settings
> # Specify min and max size of heap to JVM, e.g. 300M
> export CHUKWA_HICC_MIN_MEM> export CHUKWA_HICC_MAX_MEM>
> # HICC Jetty Server port, defaults to 4080
> #export CHUKWA_HICC_PORT>
> core-site.xml file
>
> <configuration>
> <property>
> <name>fs.default.name</name>
> <value>hdfs://localhost:9000</value>
> </property>
> </configuration>
>
>
> and chukwa-collector-conf.xml file
> ......
>
> <property>
> <name>writer.hdfs.filesystem</name>
> <value>hdfs://localhost:9000</value>
> <description>HDFS to dump to</description>
> </property>
> ......
>
>
>
> Best Regards
> Mason
>

Re: About the hicc start in eclipse

Eric Yang 2012-06-21, 05:31

You might want to check if hicc.log is written somewhere in your
system. It is default to /tmp/chukwa/logs, but it may be at different
location when running in eclipse. The log file might have more
information regarding populating /chukwa/hicc directory on hdfs.

regards,
Eric

On Wed, Jun 20, 2012 at 10:29 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> If you are running this in eclipse, chukwa-env.sh is not executed.
> Therefore you should defined all environment declared in chukwa-env.sh
> in environment variables in eclipse run configuration.
>
> regards,
> Eric
>
> On Wed, Jun 20, 2012 at 7:04 AM, mason deng <[EMAIL PROTECTED]> wrote:
>> hi ,Eric:
>>
>> thanks. you are right ,there must be a .xml file rather
>> than a directory. and i have already set it according to your instructions
>> . now the question is that the config.get("fs.default.name") result
>> is null. Actually, even if when i manually
>> loading config.get("fs.default.name") =hdfs://localhost:9000. just only
>> create a /chukwa/hicc/widgets empty directory structure on the hdfs ，and
>> did not upload the "descriptors" file to hdfs。
>> the key is why unable to find the jar file in the classpath of the
>> current。
>> This is my chukwa-env.sh
>>
>>
>> export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21
>>
>> #export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
>> export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf
>>
>> #export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
>> export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf
>>
>> export
>> CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/conf:/home/rainerdun/project/hadoop-1.0.0/conf
>> # The location of chukwa data repository (in either HDFS or your local
>> # file system, whichever you are using)
>> export chukwaRecordsRepository="/chukwa/repos/"
>>
>> # The directory where pid files are stored. CHUKWA_HOME/var/run by default.
>> #export CHUKWA_PID_DIR=/tmp/chukwa/pidDir
>>
>> # The location of chukwa logs, defaults to CHUKWA_HOME/logs
>> #export CHUKWA_LOG_DIR=/tmp/chukwa/log
>>
>> # The location to store chukwa data, defaults to CHUKWA_HOME/data
>> #export CHUKWA_DATA_DIR="${CHUKWA_HOME}/data"
>>
>> # Instance name for chukwa deployment
>> export CHUKWA_IDENT_STRING=$USER
>>
>> export JAVA_PLATFORM=Linux-i386-32
>> export JAVA_LIBRARY_PATH=${HADOOP_HOME}/lib/native/${JAVA_PLATFORM}
>>
>> # Datatbase driver name for storing Chukwa Data.
>> export JDBC_DRIVER=${TODO_CHUKWA_JDBC_DRIVER}
>>
>> # Database URL prefix for Database Loader.
>> export JDBC_URL_PREFIX=${TODO_CHUKWA_JDBC_URL_PREFIX}
>>
>> # HICC Jetty Server heap memory settings
>> # Specify min and max size of heap to JVM, e.g. 300M
>> export CHUKWA_HICC_MIN_MEM>> export CHUKWA_HICC_MAX_MEM>>
>> # HICC Jetty Server port, defaults to 4080
>> #export CHUKWA_HICC_PORT>>
>> core-site.xml file
>>
>> <configuration>
>> <property>
>> <name>fs.default.name</name>
>> <value>hdfs://localhost:9000</value>
>> </property>
>> </configuration>
>>
>>
>> and chukwa-collector-conf.xml file
>> ......
>>
>> <property>
>> <name>writer.hdfs.filesystem</name>
>> <value>hdfs://localhost:9000</value>
>> <description>HDFS to dump to</description>
>> </property>
>> ......
>>
>>
>>
>> Best Regards
>> Mason
>>

Re: About the hicc start in eclipse

mason deng 2012-06-26, 06:50

Hi Eric.
thank you for your tips. I have solved the former questions. but now , I
encountered a new problem. it is also about the hicc. last night, when i
start chuka , and log on the http://localhost:4080/hicc/. It can display
all the data as expect,that is to say every thing is ok. but this morning
,when i restart my computer and start chukwa,it doesn't load the data,the
chukwa hicc logs have no anything error tips. but in
http://localhost:4080/hicc/jsp/graph_explorer.jsp, i can get all data and
plot it .I view at the past time of the mailing list solutions,and found
that maybe the time zone problem,so i alter the time zone in Time Widget,
and changed the UTC to Asia/Shanghai .But it seems to have no effect.
Regards

mason

On Thu, Jun 21, 2012 at 1:31 PM, Eric Yang <[EMAIL PROTECTED]> wrote:

> You might want to check if hicc.log is written somewhere in your
> system. It is default to /tmp/chukwa/logs, but it may be at different
> location when running in eclipse. The log file might have more
> information regarding populating /chukwa/hicc directory on hdfs.
>
> regards,
> Eric
>
> On Wed, Jun 20, 2012 at 10:29 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> > If you are running this in eclipse, chukwa-env.sh is not executed.
> > Therefore you should defined all environment declared in chukwa-env.sh
> > in environment variables in eclipse run configuration.
> >
> > regards,
> > Eric
> >
> > On Wed, Jun 20, 2012 at 7:04 AM, mason deng <[EMAIL PROTECTED]> wrote:
> >> hi ,Eric:
> >>
> >> thanks. you are right ,there must be a .xml file
> rather
> >> than a directory. and i have already set it according to your
> instructions
> >> . now the question is that the config.get("fs.default.name")
> result
> >> is null. Actually, even if when i manually
> >> loading config.get("fs.default.name") =hdfs://localhost:9000. just
> only
> >> create a /chukwa/hicc/widgets empty directory structure on the hdfs
> ，and
> >> did not upload the "descriptors" file to hdfs。
> >> the key is why unable to find the jar file in the classpath of the
> >> current。
> >> This is my chukwa-env.sh
> >>
> >>
> >> export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21
> >>
> >> #export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
> >> export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf
> >>
> >> #export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
> >> export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf
> >>
> >> export
> >>
> CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/conf:/home/rainerdun/project/hadoop-1.0.0/conf
> >> # The location of chukwa data repository (in either HDFS or your local
> >> # file system, whichever you are using)
> >> export chukwaRecordsRepository="/chukwa/repos/"
> >>
> >> # The directory where pid files are stored. CHUKWA_HOME/var/run by
> default.
> >> #export CHUKWA_PID_DIR=/tmp/chukwa/pidDir
> >>
> >> # The location of chukwa logs, defaults to CHUKWA_HOME/logs
> >> #export CHUKWA_LOG_DIR=/tmp/chukwa/log
> >>
> >> # The location to store chukwa data, defaults to CHUKWA_HOME/data
> >> #export CHUKWA_DATA_DIR="${CHUKWA_HOME}/data"
> >>
> >> # Instance name for chukwa deployment
> >> export CHUKWA_IDENT_STRING=$USER
> >>
> >> export JAVA_PLATFORM=Linux-i386-32
> >> export JAVA_LIBRARY_PATH=${HADOOP_HOME}/lib/native/${JAVA_PLATFORM}
> >>
> >> # Datatbase driver name for storing Chukwa Data.
> >> export JDBC_DRIVER=${TODO_CHUKWA_JDBC_DRIVER}
> >>
> >> # Database URL prefix for Database Loader.
> >> export JDBC_URL_PREFIX=${TODO_CHUKWA_JDBC_URL_PREFIX}
> >>
> >> # HICC Jetty Server heap memory settings
> >> # Specify min and max size of heap to JVM, e.g. 300M
> >> export CHUKWA_HICC_MIN_MEM> >> export CHUKWA_HICC_MAX_MEM> >>
> >> # HICC Jetty Server port, defaults to 4080
> >> #export CHUKWA_HICC_PORT> >>
> >> core-site.xml file
> >>
> >> <configuration>
> >> <property>
> >> <name>fs.default.name</name>
> >> <value>hdfs://localhost:9000</value>

这个世界不相信眼泪

Re: About the hicc start in eclipse

Eric Yang 2012-06-26, 13:24

The timezone widget does not work unless the server side is set to UTC time.

Sent from my iPhone

On Jun 25, 2012, at 11:50 PM, mason deng <[EMAIL PROTECTED]> wrote:

> Hi Eric.
> thank you for your tips. I have solved the former questions. but now , I encountered a new problem. it is also about the hicc. last night, when i start chuka , and log on the http://localhost:4080/hicc/. It can display all the data as expect,that is to say every thing is ok. but this morning ,when i restart my computer and start chukwa,it doesn't load the data,the chukwa hicc logs have no anything error tips. but in http://localhost:4080/hicc/jsp/graph_explorer.jsp, i can get all data and plot it .I view at the past time of the mailing list solutions,and found that maybe the time zone problem,so i alter the time zone in Time Widget, and changed the UTC to Asia/Shanghai .But it seems to have no effect.
>
>
> Regards
> mason
>
> On Thu, Jun 21, 2012 at 1:31 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> You might want to check if hicc.log is written somewhere in your
> system. It is default to /tmp/chukwa/logs, but it may be at different
> location when running in eclipse. The log file might have more
> information regarding populating /chukwa/hicc directory on hdfs.
>
> regards,
> Eric
>
> On Wed, Jun 20, 2012 at 10:29 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> > If you are running this in eclipse, chukwa-env.sh is not executed.
> > Therefore you should defined all environment declared in chukwa-env.sh
> > in environment variables in eclipse run configuration.
> >
> > regards,
> > Eric
> >
> > On Wed, Jun 20, 2012 at 7:04 AM, mason deng <[EMAIL PROTECTED]> wrote:
> >> hi ,Eric:
> >>
> >> thanks. you are right ,there must be a .xml file rather
> >> than a directory. and i have already set it according to your instructions
> >> . now the question is that the config.get("fs.default.name") result
> >> is null. Actually, even if when i manually
> >> loading config.get("fs.default.name") =hdfs://localhost:9000. just only
> >> create a /chukwa/hicc/widgets empty directory structure on the hdfs ，and
> >> did not upload the "descriptors" file to hdfs。
> >> the key is why unable to find the jar file in the classpath of the
> >> current。
> >> This is my chukwa-env.sh
> >>
> >>
> >> export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21
> >>
> >> #export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
> >> export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf
> >>
> >> #export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
> >> export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf
> >>
> >> export
> >> CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/conf:/home/rainerdun/project/hadoop-1.0.0/conf
> >> # The location of chukwa data repository (in either HDFS or your local
> >> # file system, whichever you are using)
> >> export chukwaRecordsRepository="/chukwa/repos/"
> >>
> >> # The directory where pid files are stored. CHUKWA_HOME/var/run by default.
> >> #export CHUKWA_PID_DIR=/tmp/chukwa/pidDir
> >>
> >> # The location of chukwa logs, defaults to CHUKWA_HOME/logs
> >> #export CHUKWA_LOG_DIR=/tmp/chukwa/log
> >>
> >> # The location to store chukwa data, defaults to CHUKWA_HOME/data
> >> #export CHUKWA_DATA_DIR="${CHUKWA_HOME}/data"
> >>
> >> # Instance name for chukwa deployment
> >> export CHUKWA_IDENT_STRING=$USER
> >>
> >> export JAVA_PLATFORM=Linux-i386-32
> >> export JAVA_LIBRARY_PATH=${HADOOP_HOME}/lib/native/${JAVA_PLATFORM}
> >>
> >> # Datatbase driver name for storing Chukwa Data.
> >> export JDBC_DRIVER=${TODO_CHUKWA_JDBC_DRIVER}
> >>
> >> # Database URL prefix for Database Loader.
> >> export JDBC_URL_PREFIX=${TODO_CHUKWA_JDBC_URL_PREFIX}
> >>
> >> # HICC Jetty Server heap memory settings
> >> # Specify min and max size of heap to JVM, e.g. 300M
> >> export CHUKWA_HICC_MIN_MEM> >> export CHUKWA_HICC_MAX_MEM> >>
> >> # HICC Jetty Server port, defaults to 4080
> >> #export CHUKWA_HICC_PORT> >>

回复： About the hicc start in eclipse

星之溪 2012-06-26, 13:58

Did you mean it is necessary to set local server time zone into UTC, and then the hicc will be displayed properly. now my time zone is CST. and I indeed can not found the other error informations about the hicc.

   This is my hicc start logs when i log on http://localhost:4080/hicc/

2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:java.library.path=/home/rainerdun/project/hadoop-1.0.0/lib/native/Linux-i386-32
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:java.io.tmpdir=/tmp
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:java.compiler=<NA>
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:os.name=Linux
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:os.arch=i386
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:os.version=2.6.35-22-generic
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:user.name=rainerdun
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:user.home=/home/rainerdun
2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client environment:user.dir=/home/rainerdun/workspace/chukwa-0.5
2012-06-26 20:33:22,555 INFO 9472129@qtp-23848591-7 ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection
2012-06-26 20:33:22,573 INFO 9472129@qtp-23848591-7-SendThread() ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181
2012-06-26 20:33:22,582 INFO 9472129@qtp-23848591-7-SendThread(localhost:2181) ClientCnxn - Socket connection established to localhost/127.0.0.1:2181, initiating session
2012-06-26 20:33:22,617 INFO 9472129@qtp-23848591-7-SendThread(localhost:2181) ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13828c55ab60006, negotiated timeout = 40000
2012-06-26 20:33:23,764 INFO 30008954@qtp-23848591-4 ChukwaConfiguration - chukwaConf is /home/rainerdun/workspace/chukwa-0.5/conf
2012-06-26 20:33:24,223 INFO 29493424@qtp-23848591-6 ChukwaConfiguration - chukwaConf is /home/rainerdun/workspace/chukwa-0.5/conf
2012-06-26 20:33:24,527 INFO 29493424@qtp-23848591-6 /hicc - Iframe: init
2012-06-26 20:33:24,714 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
2012-06-26 20:33:25,012 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
2012-06-26 20:33:25,076 INFO 30008954@qtp-23848591-4 /hicc - jsp: init
2012-06-26 20:33:25,195 INFO 4508606@qtp-23848591-3 /hicc - jsp: init
2012-06-26 20:33:25,286 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
2012-06-26 20:34:14,068 INFO 21101238@qtp-23848591-2 /hicc - jsp: init
2012-06-26 20:34:25,132 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
2012-06-26 20:34:25,236 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
2012-06-26 20:34:25,550 INFO 4973260@qtp-23848591-5 /hicc - jsp: init

  Thanks .
regards mason

------------------ 原始邮件 ------------------
发件人: "Eric Yang"<[EMAIL PROTECTED]>;
发送时间: 2012年6月26日(星期二) 晚上9:24
收件人: "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
抄送: "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
主题: Re: About the hicc start in eclipse

The timezone widget does not work unless the server side is set to UTC time.

Sent from my iPhone

On Jun 25, 2012, at 11:50 PM, mason deng <[EMAIL PROTECTED]> wrote:

Hi Eric. thank you for your tips. I have solved the former questions. but now , I encountered a new problem. it is also about the hicc. last night, when i start chuka , and log on the http://localhost:4080/hicc/. It can display all the data as expect,that is to say every thing is ok. but this morning ,when i restart my computer and start chukwa,it doesn't load the data,the chukwa hicc logs have no anything error tips. but in http://localhost:4080/hicc/jsp/graph_explorer.jsp, i can get all data and plot it .I view at the past time of the mailing list solutions,and found that maybe the time zone problem,so i alter the time zone in Time Widget, and changed the UTC to Asia/Shanghai .But it seems to have no effect.

Regards mason


On Thu, Jun 21, 2012 at 1:31 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
You might want to check if hicc.log is written somewhere in your
system. It is default to /tmp/chukwa/logs, but it may be at different
location when running in eclipse. The log file might have more
information regarding populating /chukwa/hicc directory on hdfs.

regards,
Eric

On Wed, Jun 20, 2012 at 10:29 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
> If you are running this in eclipse, chukwa-env.sh is not executed.
> Therefore you should defined all environment declared in chukwa-env.sh
> in environment variables in eclipse run configuration.
>
> regards,
> Eric
>
> On Wed, Jun 20, 2012 at 7:04 AM, mason deng <[EMAIL PROTECTED]> wrote:
>> hi ,Eric:
>>
>> thanks. you are right ,there must be a .xml file rather
>> than a directory. and i have already set it according to your instructions
>> . now the question is that the config.get("fs.default.name") result
>> is null. Actually, even if when i manually
>> loading config.get("fs.default.name") =hdfs://localhost:9000. just only
>> create a /chukwa/hicc/widgets empty directory structure on the hdfs ，and
>> did not upload the "descriptors" file to hdfs。
>> the key is why unable to find the jar file in the classpath of the
>> current。
>> This is my chukwa-env.sh
>>
>>
>> export JAVA_HOME=/home/rainerdun/project/jdk1.6.0_21
>>
>> #export HADOOP_HOME=/home/rainerdun/project/hadoop-1.0.0
>> export HADOOP_CONF_DIR=/home/rainerdun/project/hadoop-1.0.0/conf
>>
>> #export HBASE_HOME=/home/rainerdun/project/hbase-0.90.4
>> export HBASE_CONF_DIR=/home/rainerdun/project/hbase-0.90.4/conf
>>
>> export
>> CLASSPATH=${CLASSPATH}:/home/rainerdun/project/hbase-0.90.4/

Re: 回复： About the hicc start in eclipse

Eric Yang 2012-06-27, 06:00

I hope this is the case. Let us know how it turns out.

regards,
Eric

On Tue, Jun 26, 2012 at 6:58 AM, 星之溪 <[EMAIL PROTECTED]> wrote:
>
> Did you mean it is necessary to set local server time zone into UTC, and
> then the hicc will be displayed properly. now my time zone is CST. and I
> indeed can not found the other error informations about the hicc.
>
>
> This is my hicc start logs when i log on http://localhost:4080/hicc/
>
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:java.library.path=/home/rainerdun/project/hadoop-1.0.0/lib/native/Linux-i386-32
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:java.io.tmpdir=/tmp
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:java.compiler=<NA>
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:os.name=Linux
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:os.arch=i386
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:os.version=2.6.35-22-generic
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:user.name=rainerdun
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:user.home=/home/rainerdun
> 2012-06-26 20:33:22,554 INFO 9472129@qtp-23848591-7 ZooKeeper - Client
> environment:user.dir=/home/rainerdun/workspace/chukwa-0.5
> 2012-06-26 20:33:22,555 INFO 9472129@qtp-23848591-7 ZooKeeper - Initiating
> client connection, connectString=localhost:2181 sessionTimeout=180000
> watcher=hconnection
> 2012-06-26 20:33:22,573 INFO 9472129@qtp-23848591-7-SendThread() ClientCnxn
> - Opening socket connection to server localhost/127.0.0.1:2181
> 2012-06-26 20:33:22,582 INFO
> 9472129@qtp-23848591-7-SendThread(localhost:2181) ClientCnxn - Socket
> connection established to localhost/127.0.0.1:2181, initiating session
> 2012-06-26 20:33:22,617 INFO
> 9472129@qtp-23848591-7-SendThread(localhost:2181) ClientCnxn - Session
> establishment complete on server localhost/127.0.0.1:2181, sessionid > 0x13828c55ab60006, negotiated timeout = 40000
> 2012-06-26 20:33:23,764 INFO 30008954@qtp-23848591-4 ChukwaConfiguration -
> chukwaConf is /home/rainerdun/workspace/chukwa-0.5/conf
> 2012-06-26 20:33:24,223 INFO 29493424@qtp-23848591-6 ChukwaConfiguration -
> chukwaConf is /home/rainerdun/workspace/chukwa-0.5/conf
> 2012-06-26 20:33:24,527 INFO 29493424@qtp-23848591-6 /hicc - Iframe: init
> 2012-06-26 20:33:24,714 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
> 2012-06-26 20:33:25,012 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
> 2012-06-26 20:33:25,076 INFO 30008954@qtp-23848591-4 /hicc - jsp: init
> 2012-06-26 20:33:25,195 INFO 4508606@qtp-23848591-3 /hicc - jsp: init
> 2012-06-26 20:33:25,286 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
> 2012-06-26 20:34:14,068 INFO 21101238@qtp-23848591-2 /hicc - jsp: init
> 2012-06-26 20:34:25,132 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
> 2012-06-26 20:34:25,236 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
> 2012-06-26 20:34:25,550 INFO 4973260@qtp-23848591-5 /hicc - jsp: init
>
> Thanks .
>
> regards
>
> mason
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Eric Yang"<[EMAIL PROTECTED]>;
> 发送时间: 2012年6月26日(星期二) 晚上9:24
> 收件人: "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
> 抄送: "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
> 主题: Re: About the hicc start in eclipse
>
> The timezone widget does not work unless the server side is set to UTC time.
>
> Sent from my iPhone
>
> On Jun 25, 2012, at 11:50 PM, mason deng <[EMAIL PROTECTED]> wrote:
>
> Hi Eric.
> thank you for your tips. I have solved the former questions. but now , I
> encountered a new problem. it is also about the hicc. last night, when i
> start chuka , and log on the http://localhost:4080/hicc/. It can display
> all the data as expect,that is to say every thing is ok. but this morning