Dan Young
2012-11-15, 16:10
Brock Noland
2012-11-15, 16:53
Alexander Alten-Lorenz
2012-11-15, 17:02
Dan Young
2012-11-15, 17:03
Dan Young
2012-11-15, 17:04
Dan Young
2012-11-15, 17:06
Brock Noland
2012-11-15, 17:08
Dan Young
2012-11-15, 17:16
Brock Noland
2012-11-15, 17:33
Dan Young
2012-11-15, 18:00
-
flume-ng script error...Dan Young 2012-11-15, 16:10
I'm testing the spooling directory source in 1.3. Last night I did a git
pull/mvn install on the 1.3 branch, and now I'm getting the following error
when I run /bin/flume-ng
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/flume/tools/GetJavaProperty
Caused by: java.lang.ClassNotFoundException:
org.apache.flume.tools.GetJavaProperty
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
I did a diff on the previous flume-ng script, copied it over and ran
bin/flume-ng without any such error. Here's the diff
diff flume-ng flume-ng.PREVIOUS
74c74
< java.library.path)
---
> java.library.path 2>/dev/null)
93c93
< HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
---
> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
123c123
< java.library.path)
---
> java.library.path 2>/dev/null)
142c142
< HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
---
> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
Regards,
Dano
pull/mvn install on the 1.3 branch, and now I'm getting the following error
when I run /bin/flume-ng
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/flume/tools/GetJavaProperty
Caused by: java.lang.ClassNotFoundException:
org.apache.flume.tools.GetJavaProperty
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
I did a diff on the previous flume-ng script, copied it over and ran
bin/flume-ng without any such error. Here's the diff
diff flume-ng flume-ng.PREVIOUS
74c74
< java.library.path)
---
> java.library.path 2>/dev/null)
93c93
< HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
---
> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
123c123
< java.library.path)
---
> java.library.path 2>/dev/null)
142c142
< HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
---
> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
Regards,
Dano
-
Re: flume-ng script error...Brock Noland 2012-11-15, 16:53
The script changes just un-hide that error message. I do wonder why
you canot find that class it's in the core jar. Are you overriding the
classpath or anything?
On Thu, Nov 15, 2012 at 10:10 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> I'm testing the spooling directory source in 1.3. Last night I did a git
> pull/mvn install on the 1.3 branch, and now I'm getting the following error
> when I run /bin/flume-ng
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/flume/tools/GetJavaProperty
> Caused by: java.lang.ClassNotFoundException:
> org.apache.flume.tools.GetJavaProperty
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
>
> I did a diff on the previous flume-ng script, copied it over and ran
> bin/flume-ng without any such error. Here's the diff
>
> diff flume-ng flume-ng.PREVIOUS
> 74c74
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 93c93
> < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> ---
>> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> 123c123
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 142c142
> < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> ---
>> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>
>
> Regards,
>
> Dano
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
you canot find that class it's in the core jar. Are you overriding the
classpath or anything?
On Thu, Nov 15, 2012 at 10:10 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> I'm testing the spooling directory source in 1.3. Last night I did a git
> pull/mvn install on the 1.3 branch, and now I'm getting the following error
> when I run /bin/flume-ng
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/flume/tools/GetJavaProperty
> Caused by: java.lang.ClassNotFoundException:
> org.apache.flume.tools.GetJavaProperty
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
>
> I did a diff on the previous flume-ng script, copied it over and ran
> bin/flume-ng without any such error. Here's the diff
>
> diff flume-ng flume-ng.PREVIOUS
> 74c74
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 93c93
> < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> ---
>> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> 123c123
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 142c142
> < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> ---
>> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>
>
> Regards,
>
> Dano
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
-
Re: flume-ng script error...Alexander Alten-Lorenz 2012-11-15, 17:02
Hi,
sounds like you have other jars in path (previous installations?), which mess up your new build. Do you have tried to start the new one from a different directory?
cheers
- Alex
On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> I'm testing the spooling directory source in 1.3. Last night I did a git
> pull/mvn install on the 1.3 branch, and now I'm getting the following error
> when I run /bin/flume-ng
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/flume/tools/GetJavaProperty
> Caused by: java.lang.ClassNotFoundException:
> org.apache.flume.tools.GetJavaProperty
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
>
> I did a diff on the previous flume-ng script, copied it over and ran
> bin/flume-ng without any such error. Here's the diff
>
> diff flume-ng flume-ng.PREVIOUS
> 74c74
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 93c93
> < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> ---
>> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> 123c123
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 142c142
> < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> ---
>> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>
>
> Regards,
>
> Dano
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
sounds like you have other jars in path (previous installations?), which mess up your new build. Do you have tried to start the new one from a different directory?
cheers
- Alex
On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> I'm testing the spooling directory source in 1.3. Last night I did a git
> pull/mvn install on the 1.3 branch, and now I'm getting the following error
> when I run /bin/flume-ng
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/flume/tools/GetJavaProperty
> Caused by: java.lang.ClassNotFoundException:
> org.apache.flume.tools.GetJavaProperty
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
>
> I did a diff on the previous flume-ng script, copied it over and ran
> bin/flume-ng without any such error. Here's the diff
>
> diff flume-ng flume-ng.PREVIOUS
> 74c74
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 93c93
> < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> ---
>> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> 123c123
> < java.library.path)
> ---
>> java.library.path 2>/dev/null)
> 142c142
> < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> ---
>> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>
>
> Regards,
>
> Dano
--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
-
Re: flume-ng script error...Dan Young 2012-11-15, 17:03
Hey Brock,
I'm not (at least that IO know of). Here's the output when I start it:
Info: Including Hadoop libraries found via
(/Users/dyoung/hadoop/bin/hadoop) for HDFS access
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/flume/tools/GetJavaProperty
Caused by: java.lang.ClassNotFoundException:
org.apache.flume.tools.GetJavaProperty
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Info: Excluding
/Users/dyoung/hadoop-1.0.4/libexec/../lib/slf4j-api-1.4.3.jar from classpath
Info: Excluding
/Users/dyoung/hadoop-1.0.4/libexec/../lib/slf4j-log4j12-1.4.3.jar from
classpath
+ exec /Library/Java/Home/bin/java -Xms100m -Xmx200m
-Dcom.sun.management.jmxremote -Dflume.root.logger=DEBUG,console -cp
'/Users/dyoung/flume/conf:/Users/dyoung/flume/lib/*:/Users/dyoung/hadoop-1.0.4/libexec/../conf:/Library/Java/Home/lib/tools.jar:/Users/dyoung/hadoop-1.0.4/libexec/..:/Users/dyoung/hadoop-1.0.4/libexec/../hadoop-core-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/asm-3.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/aspectjrt-1.6.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/aspectjtools-1.6.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-beanutils-1.7.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-beanutils-core-1.8.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-cli-1.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-codec-1.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-collections-3.2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-configuration-1.6.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-daemon-1.0.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-digester-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-el-1.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-httpclient-3.0.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-io-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-lang-2.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-logging-1.1.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-logging-api-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-math-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-net-1.4.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/core-3.1.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-capacity-scheduler-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-fairscheduler-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-thriftfs-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hsqldb-1.8.0.10.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jackson-core-asl-1.8.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jasper-compiler-5.5.12.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jasper-runtime-5.5.12.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jdeb-0.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-core-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-json-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-server-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jets3t-0.6.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jetty-6.1.26.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jetty-util-6.1.26.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsch-0.1.42.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/junit-4.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/kfs-0.2.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/log4j-1.2.15.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/mockito-all-1.8.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/oro-2.0.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/pig-0.11.0-SNAPSHOT-withouthadoop.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/piggybank.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/servlet-api-2.5-20081211.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/xmlenc-0.52.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsp-2.1/jsp-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/Users/dyoung/hadoop/lib'
-Djava.library.path= org.apache.flume.node.Application -n agent1 -f
conf/spooldir.conf
......
......
......
Here's my conf/flume-env.sh
#JAVA_HOME=/usr/lib/jvm/java-6-sun
# Give Flume more memory and pre-allocate, enable remote monitoring via JMX
JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote"
# Note that the Flume conf directory is always included in the classpath.
#FLUME_CLASSPATH=""
I don't have any classpath settings in my env as well....
Should I be checking for anything else to confirm?
Regards,
Dano
On Thu, Nov 15, 2012 at 9:53 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
I'm not (at least that IO know of). Here's the output when I start it:
Info: Including Hadoop libraries found via
(/Users/dyoung/hadoop/bin/hadoop) for HDFS access
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/flume/tools/GetJavaProperty
Caused by: java.lang.ClassNotFoundException:
org.apache.flume.tools.GetJavaProperty
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Info: Excluding
/Users/dyoung/hadoop-1.0.4/libexec/../lib/slf4j-api-1.4.3.jar from classpath
Info: Excluding
/Users/dyoung/hadoop-1.0.4/libexec/../lib/slf4j-log4j12-1.4.3.jar from
classpath
+ exec /Library/Java/Home/bin/java -Xms100m -Xmx200m
-Dcom.sun.management.jmxremote -Dflume.root.logger=DEBUG,console -cp
'/Users/dyoung/flume/conf:/Users/dyoung/flume/lib/*:/Users/dyoung/hadoop-1.0.4/libexec/../conf:/Library/Java/Home/lib/tools.jar:/Users/dyoung/hadoop-1.0.4/libexec/..:/Users/dyoung/hadoop-1.0.4/libexec/../hadoop-core-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/asm-3.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/aspectjrt-1.6.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/aspectjtools-1.6.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-beanutils-1.7.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-beanutils-core-1.8.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-cli-1.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-codec-1.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-collections-3.2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-configuration-1.6.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-daemon-1.0.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-digester-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-el-1.0.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-httpclient-3.0.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-io-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-lang-2.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-logging-1.1.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-logging-api-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-math-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/commons-net-1.4.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/core-3.1.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-capacity-scheduler-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-fairscheduler-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hadoop-thriftfs-1.0.4.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/hsqldb-1.8.0.10.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jackson-core-asl-1.8.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jasper-compiler-5.5.12.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jasper-runtime-5.5.12.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jdeb-0.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-core-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-json-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jersey-server-1.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jets3t-0.6.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jetty-6.1.26.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jetty-util-6.1.26.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsch-0.1.42.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/junit-4.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/kfs-0.2.2.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/log4j-1.2.15.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/mockito-all-1.8.5.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/oro-2.0.8.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/pig-0.11.0-SNAPSHOT-withouthadoop.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/piggybank.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/servlet-api-2.5-20081211.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/xmlenc-0.52.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsp-2.1/jsp-2.1.jar:/Users/dyoung/hadoop-1.0.4/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/Users/dyoung/hadoop/lib'
-Djava.library.path= org.apache.flume.node.Application -n agent1 -f
conf/spooldir.conf
......
......
......
Here's my conf/flume-env.sh
#JAVA_HOME=/usr/lib/jvm/java-6-sun
# Give Flume more memory and pre-allocate, enable remote monitoring via JMX
JAVA_OPTS="-Xms100m -Xmx200m -Dcom.sun.management.jmxremote"
# Note that the Flume conf directory is always included in the classpath.
#FLUME_CLASSPATH=""
I don't have any classpath settings in my env as well....
Should I be checking for anything else to confirm?
Regards,
Dano
On Thu, Nov 15, 2012 at 9:53 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
-
Re: flume-ng script error...Dan Young 2012-11-15, 17:04
I'm sym linking the flume dir...let me nuke the old one......and retry...
Dano
On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> sounds like you have other jars in path (previous installations?), which
> mess up your new build. Do you have tried to start the new one from a
> different directory?
>
> cheers
> - Alex
>
>
>
> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>
> > I'm testing the spooling directory source in 1.3. Last night I did a git
> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> error
> > when I run /bin/flume-ng
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/flume/tools/GetJavaProperty
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.flume.tools.GetJavaProperty
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >
> >
> >
> > I did a diff on the previous flume-ng script, copied it over and ran
> > bin/flume-ng without any such error. Here's the diff
> >
> > diff flume-ng flume-ng.PREVIOUS
> > 74c74
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 93c93
> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> > ---
> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> > 123c123
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 142c142
> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> > ---
> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >
> >
> > Regards,
> >
> > Dano
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
Dano
On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> sounds like you have other jars in path (previous installations?), which
> mess up your new build. Do you have tried to start the new one from a
> different directory?
>
> cheers
> - Alex
>
>
>
> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>
> > I'm testing the spooling directory source in 1.3. Last night I did a git
> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> error
> > when I run /bin/flume-ng
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/flume/tools/GetJavaProperty
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.flume.tools.GetJavaProperty
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >
> >
> >
> > I did a diff on the previous flume-ng script, copied it over and ran
> > bin/flume-ng without any such error. Here's the diff
> >
> > diff flume-ng flume-ng.PREVIOUS
> > 74c74
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 93c93
> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> > ---
> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> > 123c123
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 142c142
> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> > ---
> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >
> >
> > Regards,
> >
> > Dano
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
-
Re: flume-ng script error...Dan Young 2012-11-15, 17:06
I nuked the previous apache-flume-1.3.0/ dir and still get the error....
Regards,
Dano
On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> sounds like you have other jars in path (previous installations?), which
> mess up your new build. Do you have tried to start the new one from a
> different directory?
>
> cheers
> - Alex
>
>
>
> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>
> > I'm testing the spooling directory source in 1.3. Last night I did a git
> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> error
> > when I run /bin/flume-ng
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/flume/tools/GetJavaProperty
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.flume.tools.GetJavaProperty
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >
> >
> >
> > I did a diff on the previous flume-ng script, copied it over and ran
> > bin/flume-ng without any such error. Here's the diff
> >
> > diff flume-ng flume-ng.PREVIOUS
> > 74c74
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 93c93
> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> > ---
> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> > 123c123
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 142c142
> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> > ---
> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >
> >
> > Regards,
> >
> > Dano
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
Regards,
Dano
On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> sounds like you have other jars in path (previous installations?), which
> mess up your new build. Do you have tried to start the new one from a
> different directory?
>
> cheers
> - Alex
>
>
>
> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>
> > I'm testing the spooling directory source in 1.3. Last night I did a git
> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> error
> > when I run /bin/flume-ng
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/flume/tools/GetJavaProperty
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.flume.tools.GetJavaProperty
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >
> >
> >
> > I did a diff on the previous flume-ng script, copied it over and ran
> > bin/flume-ng without any such error. Here's the diff
> >
> > diff flume-ng flume-ng.PREVIOUS
> > 74c74
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 93c93
> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> > ---
> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> > 123c123
> > < java.library.path)
> > ---
> >> java.library.path 2>/dev/null)
> > 142c142
> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> > ---
> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >
> >
> > Regards,
> >
> > Dano
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
-
Re: flume-ng script error...Brock Noland 2012-11-15, 17:08
Could you put
set -x
at the very top of the script, post the entire output to pastebin, and
send us the link?
Brock
On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> I nuked the previous apache-flume-1.3.0/ dir and still get the error....
>
> Regards,
>
> Dano
>
>
> On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>
>> sounds like you have other jars in path (previous installations?), which
>> mess up your new build. Do you have tried to start the new one from a
>> different directory?
>>
>> cheers
>> - Alex
>>
>>
>>
>> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>>
>> > I'm testing the spooling directory source in 1.3. Last night I did a
>> > git
>> > pull/mvn install on the 1.3 branch, and now I'm getting the following
>> > error
>> > when I run /bin/flume-ng
>> >
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/flume/tools/GetJavaProperty
>> > Caused by: java.lang.ClassNotFoundException:
>> > org.apache.flume.tools.GetJavaProperty
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> >
>> >
>> >
>> > I did a diff on the previous flume-ng script, copied it over and ran
>> > bin/flume-ng without any such error. Here's the diff
>> >
>> > diff flume-ng flume-ng.PREVIOUS
>> > 74c74
>> > < java.library.path)
>> > ---
>> >> java.library.path 2>/dev/null)
>> > 93c93
>> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
>> > ---
>> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
>> > 123c123
>> > < java.library.path)
>> > ---
>> >> java.library.path 2>/dev/null)
>> > 142c142
>> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
>> > ---
>> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>> >
>> >
>> > Regards,
>> >
>> > Dano
>>
>> --
>> Alexander Alten-Lorenz
>> http://mapredit.blogspot.com
>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
set -x
at the very top of the script, post the entire output to pastebin, and
send us the link?
Brock
On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> I nuked the previous apache-flume-1.3.0/ dir and still get the error....
>
> Regards,
>
> Dano
>
>
> On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>
>> sounds like you have other jars in path (previous installations?), which
>> mess up your new build. Do you have tried to start the new one from a
>> different directory?
>>
>> cheers
>> - Alex
>>
>>
>>
>> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>>
>> > I'm testing the spooling directory source in 1.3. Last night I did a
>> > git
>> > pull/mvn install on the 1.3 branch, and now I'm getting the following
>> > error
>> > when I run /bin/flume-ng
>> >
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/flume/tools/GetJavaProperty
>> > Caused by: java.lang.ClassNotFoundException:
>> > org.apache.flume.tools.GetJavaProperty
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> >
>> >
>> >
>> > I did a diff on the previous flume-ng script, copied it over and ran
>> > bin/flume-ng without any such error. Here's the diff
>> >
>> > diff flume-ng flume-ng.PREVIOUS
>> > 74c74
>> > < java.library.path)
>> > ---
>> >> java.library.path 2>/dev/null)
>> > 93c93
>> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
>> > ---
>> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
>> > 123c123
>> > < java.library.path)
>> > ---
>> >> java.library.path 2>/dev/null)
>> > 142c142
>> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
>> > ---
>> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>> >
>> >
>> > Regards,
>> >
>> > Dano
>>
>> --
>> Alexander Alten-Lorenz
>> http://mapredit.blogspot.com
>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
-
Re: flume-ng script error...Dan Young 2012-11-15, 17:16
http://pastebin.com/sn1ThHmm
Dano
On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> Could you put
>
> set -x
>
> at the very top of the script, post the entire output to pastebin, and
> send us the link?
>
> Brock
>
> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> > I nuked the previous apache-flume-1.3.0/ dir and still get the error....
> >
> > Regards,
> >
> > Dano
> >
> >
> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> > <[EMAIL PROTECTED]> wrote:
> >>
> >> Hi,
> >>
> >> sounds like you have other jars in path (previous installations?), which
> >> mess up your new build. Do you have tried to start the new one from a
> >> different directory?
> >>
> >> cheers
> >> - Alex
> >>
> >>
> >>
> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> >>
> >> > I'm testing the spooling directory source in 1.3. Last night I did a
> >> > git
> >> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> >> > error
> >> > when I run /bin/flume-ng
> >> >
> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> > org/apache/flume/tools/GetJavaProperty
> >> > Caused by: java.lang.ClassNotFoundException:
> >> > org.apache.flume.tools.GetJavaProperty
> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >> > at java.security.AccessController.doPrivileged(Native Method)
> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >> >
> >> >
> >> >
> >> > I did a diff on the previous flume-ng script, copied it over and ran
> >> > bin/flume-ng without any such error. Here's the diff
> >> >
> >> > diff flume-ng flume-ng.PREVIOUS
> >> > 74c74
> >> > < java.library.path)
> >> > ---
> >> >> java.library.path 2>/dev/null)
> >> > 93c93
> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> >> > ---
> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> >> > 123c123
> >> > < java.library.path)
> >> > ---
> >> >> java.library.path 2>/dev/null)
> >> > 142c142
> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> >> > ---
> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >> >
> >> >
> >> > Regards,
> >> >
> >> > Dano
> >>
> >> --
> >> Alexander Alten-Lorenz
> >> http://mapredit.blogspot.com
> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >>
> >
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
Dano
On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> Could you put
>
> set -x
>
> at the very top of the script, post the entire output to pastebin, and
> send us the link?
>
> Brock
>
> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> > I nuked the previous apache-flume-1.3.0/ dir and still get the error....
> >
> > Regards,
> >
> > Dano
> >
> >
> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> > <[EMAIL PROTECTED]> wrote:
> >>
> >> Hi,
> >>
> >> sounds like you have other jars in path (previous installations?), which
> >> mess up your new build. Do you have tried to start the new one from a
> >> different directory?
> >>
> >> cheers
> >> - Alex
> >>
> >>
> >>
> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> >>
> >> > I'm testing the spooling directory source in 1.3. Last night I did a
> >> > git
> >> > pull/mvn install on the 1.3 branch, and now I'm getting the following
> >> > error
> >> > when I run /bin/flume-ng
> >> >
> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> > org/apache/flume/tools/GetJavaProperty
> >> > Caused by: java.lang.ClassNotFoundException:
> >> > org.apache.flume.tools.GetJavaProperty
> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >> > at java.security.AccessController.doPrivileged(Native Method)
> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >> >
> >> >
> >> >
> >> > I did a diff on the previous flume-ng script, copied it over and ran
> >> > bin/flume-ng without any such error. Here's the diff
> >> >
> >> > diff flume-ng flume-ng.PREVIOUS
> >> > 74c74
> >> > < java.library.path)
> >> > ---
> >> >> java.library.path 2>/dev/null)
> >> > 93c93
> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> >> > ---
> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> >> > 123c123
> >> > < java.library.path)
> >> > ---
> >> >> java.library.path 2>/dev/null)
> >> > 142c142
> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> >> > ---
> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >> >
> >> >
> >> > Regards,
> >> >
> >> > Dano
> >>
> >> --
> >> Alexander Alten-Lorenz
> >> http://mapredit.blogspot.com
> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >>
> >
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
-
Re: flume-ng script error...Brock Noland 2012-11-15, 17:33
OK, are you setting HADOOP_CLASSPATH in your hadoop-env.sh?
If so, it should be something like:
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
or
if [[ -z $HADOOP_CLASSPATH ]]
then
export HADOOP_CLASSPATH="whatever"
else
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
fi
On Thu, Nov 15, 2012 at 11:16 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> http://pastebin.com/sn1ThHmm
>
> Dano
>
>
> On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>
>> Could you put
>>
>> set -x
>>
>> at the very top of the script, post the entire output to pastebin, and
>> send us the link?
>>
>> Brock
>>
>> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
>> > I nuked the previous apache-flume-1.3.0/ dir and still get the
>> > error....
>> >
>> > Regards,
>> >
>> > Dano
>> >
>> >
>> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
>> > <[EMAIL PROTECTED]> wrote:
>> >>
>> >> Hi,
>> >>
>> >> sounds like you have other jars in path (previous installations?),
>> >> which
>> >> mess up your new build. Do you have tried to start the new one from a
>> >> different directory?
>> >>
>> >> cheers
>> >> - Alex
>> >>
>> >>
>> >>
>> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>> >>
>> >> > I'm testing the spooling directory source in 1.3. Last night I did a
>> >> > git
>> >> > pull/mvn install on the 1.3 branch, and now I'm getting the following
>> >> > error
>> >> > when I run /bin/flume-ng
>> >> >
>> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> >> > org/apache/flume/tools/GetJavaProperty
>> >> > Caused by: java.lang.ClassNotFoundException:
>> >> > org.apache.flume.tools.GetJavaProperty
>> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> >> > at java.security.AccessController.doPrivileged(Native Method)
>> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> >> >
>> >> >
>> >> >
>> >> > I did a diff on the previous flume-ng script, copied it over and ran
>> >> > bin/flume-ng without any such error. Here's the diff
>> >> >
>> >> > diff flume-ng flume-ng.PREVIOUS
>> >> > 74c74
>> >> > < java.library.path)
>> >> > ---
>> >> >> java.library.path 2>/dev/null)
>> >> > 93c93
>> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
>> >> > ---
>> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
>> >> > 123c123
>> >> > < java.library.path)
>> >> > ---
>> >> >> java.library.path 2>/dev/null)
>> >> > 142c142
>> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
>> >> > ---
>> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>> >> >
>> >> >
>> >> > Regards,
>> >> >
>> >> > Dano
>> >>
>> >> --
>> >> Alexander Alten-Lorenz
>> >> http://mapredit.blogspot.com
>> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>> >>
>> >
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce -
>> http://incubator.apache.org/mrunit/
>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
If so, it should be something like:
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
or
if [[ -z $HADOOP_CLASSPATH ]]
then
export HADOOP_CLASSPATH="whatever"
else
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
fi
On Thu, Nov 15, 2012 at 11:16 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> http://pastebin.com/sn1ThHmm
>
> Dano
>
>
> On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
>>
>> Could you put
>>
>> set -x
>>
>> at the very top of the script, post the entire output to pastebin, and
>> send us the link?
>>
>> Brock
>>
>> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]> wrote:
>> > I nuked the previous apache-flume-1.3.0/ dir and still get the
>> > error....
>> >
>> > Regards,
>> >
>> > Dano
>> >
>> >
>> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
>> > <[EMAIL PROTECTED]> wrote:
>> >>
>> >> Hi,
>> >>
>> >> sounds like you have other jars in path (previous installations?),
>> >> which
>> >> mess up your new build. Do you have tried to start the new one from a
>> >> different directory?
>> >>
>> >> cheers
>> >> - Alex
>> >>
>> >>
>> >>
>> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
>> >>
>> >> > I'm testing the spooling directory source in 1.3. Last night I did a
>> >> > git
>> >> > pull/mvn install on the 1.3 branch, and now I'm getting the following
>> >> > error
>> >> > when I run /bin/flume-ng
>> >> >
>> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> >> > org/apache/flume/tools/GetJavaProperty
>> >> > Caused by: java.lang.ClassNotFoundException:
>> >> > org.apache.flume.tools.GetJavaProperty
>> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> >> > at java.security.AccessController.doPrivileged(Native Method)
>> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> >> >
>> >> >
>> >> >
>> >> > I did a diff on the previous flume-ng script, copied it over and ran
>> >> > bin/flume-ng without any such error. Here's the diff
>> >> >
>> >> > diff flume-ng flume-ng.PREVIOUS
>> >> > 74c74
>> >> > < java.library.path)
>> >> > ---
>> >> >> java.library.path 2>/dev/null)
>> >> > 93c93
>> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
>> >> > ---
>> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
>> >> > 123c123
>> >> > < java.library.path)
>> >> > ---
>> >> >> java.library.path 2>/dev/null)
>> >> > 142c142
>> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
>> >> > ---
>> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
>> >> >
>> >> >
>> >> > Regards,
>> >> >
>> >> > Dano
>> >>
>> >> --
>> >> Alexander Alten-Lorenz
>> >> http://mapredit.blogspot.com
>> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>> >>
>> >
>>
>>
>>
>> --
>> Apache MRUnit - Unit testing MapReduce -
>> http://incubator.apache.org/mrunit/
>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
-
Re: flume-ng script error...Dan Young 2012-11-15, 18:00
Hey Brock,
That was it. I took that out of the hadoop-env.sh and now we're laughin' !
Thank you.
Regards,
Dano
On Thu, Nov 15, 2012 at 10:33 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> OK, are you setting HADOOP_CLASSPATH in your hadoop-env.sh?
>
> If so, it should be something like:
>
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
>
> or
>
> if [[ -z $HADOOP_CLASSPATH ]]
> then
> export HADOOP_CLASSPATH="whatever"
> else
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
> fi
>
> On Thu, Nov 15, 2012 at 11:16 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> > http://pastebin.com/sn1ThHmm
> >
> > Dano
> >
> >
> > On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]>
> wrote:
> >>
> >> Could you put
> >>
> >> set -x
> >>
> >> at the very top of the script, post the entire output to pastebin, and
> >> send us the link?
> >>
> >> Brock
> >>
> >> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]>
> wrote:
> >> > I nuked the previous apache-flume-1.3.0/ dir and still get the
> >> > error....
> >> >
> >> > Regards,
> >> >
> >> > Dano
> >> >
> >> >
> >> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> >> > <[EMAIL PROTECTED]> wrote:
> >> >>
> >> >> Hi,
> >> >>
> >> >> sounds like you have other jars in path (previous installations?),
> >> >> which
> >> >> mess up your new build. Do you have tried to start the new one from a
> >> >> different directory?
> >> >>
> >> >> cheers
> >> >> - Alex
> >> >>
> >> >>
> >> >>
> >> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> >> >>
> >> >> > I'm testing the spooling directory source in 1.3. Last night I
> did a
> >> >> > git
> >> >> > pull/mvn install on the 1.3 branch, and now I'm getting the
> following
> >> >> > error
> >> >> > when I run /bin/flume-ng
> >> >> >
> >> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> >> > org/apache/flume/tools/GetJavaProperty
> >> >> > Caused by: java.lang.ClassNotFoundException:
> >> >> > org.apache.flume.tools.GetJavaProperty
> >> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >> >> > at java.security.AccessController.doPrivileged(Native Method)
> >> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >> >> >
> >> >> >
> >> >> >
> >> >> > I did a diff on the previous flume-ng script, copied it over and
> ran
> >> >> > bin/flume-ng without any such error. Here's the diff
> >> >> >
> >> >> > diff flume-ng flume-ng.PREVIOUS
> >> >> > 74c74
> >> >> > < java.library.path)
> >> >> > ---
> >> >> >> java.library.path 2>/dev/null)
> >> >> > 93c93
> >> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> >> >> > ---
> >> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> >> >> > 123c123
> >> >> > < java.library.path)
> >> >> > ---
> >> >> >> java.library.path 2>/dev/null)
> >> >> > 142c142
> >> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> >> >> > ---
> >> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >> >> >
> >> >> >
> >> >> > Regards,
> >> >> >
> >> >> > Dano
> >> >>
> >> >> --
> >> >> Alexander Alten-Lorenz
> >> >> http://mapredit.blogspot.com
> >> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Apache MRUnit - Unit testing MapReduce -
> >> http://incubator.apache.org/mrunit/
> >
> >
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
That was it. I took that out of the hadoop-env.sh and now we're laughin' !
Thank you.
Regards,
Dano
On Thu, Nov 15, 2012 at 10:33 AM, Brock Noland <[EMAIL PROTECTED]> wrote:
> OK, are you setting HADOOP_CLASSPATH in your hadoop-env.sh?
>
> If so, it should be something like:
>
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
>
> or
>
> if [[ -z $HADOOP_CLASSPATH ]]
> then
> export HADOOP_CLASSPATH="whatever"
> else
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:whatever"
> fi
>
> On Thu, Nov 15, 2012 at 11:16 AM, Dan Young <[EMAIL PROTECTED]> wrote:
> > http://pastebin.com/sn1ThHmm
> >
> > Dano
> >
> >
> > On Thu, Nov 15, 2012 at 10:08 AM, Brock Noland <[EMAIL PROTECTED]>
> wrote:
> >>
> >> Could you put
> >>
> >> set -x
> >>
> >> at the very top of the script, post the entire output to pastebin, and
> >> send us the link?
> >>
> >> Brock
> >>
> >> On Thu, Nov 15, 2012 at 11:06 AM, Dan Young <[EMAIL PROTECTED]>
> wrote:
> >> > I nuked the previous apache-flume-1.3.0/ dir and still get the
> >> > error....
> >> >
> >> > Regards,
> >> >
> >> > Dano
> >> >
> >> >
> >> > On Thu, Nov 15, 2012 at 10:02 AM, Alexander Alten-Lorenz
> >> > <[EMAIL PROTECTED]> wrote:
> >> >>
> >> >> Hi,
> >> >>
> >> >> sounds like you have other jars in path (previous installations?),
> >> >> which
> >> >> mess up your new build. Do you have tried to start the new one from a
> >> >> different directory?
> >> >>
> >> >> cheers
> >> >> - Alex
> >> >>
> >> >>
> >> >>
> >> >> On Nov 15, 2012, at 5:10 PM, Dan Young <[EMAIL PROTECTED]> wrote:
> >> >>
> >> >> > I'm testing the spooling directory source in 1.3. Last night I
> did a
> >> >> > git
> >> >> > pull/mvn install on the 1.3 branch, and now I'm getting the
> following
> >> >> > error
> >> >> > when I run /bin/flume-ng
> >> >> >
> >> >> > Exception in thread "main" java.lang.NoClassDefFoundError:
> >> >> > org/apache/flume/tools/GetJavaProperty
> >> >> > Caused by: java.lang.ClassNotFoundException:
> >> >> > org.apache.flume.tools.GetJavaProperty
> >> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >> >> > at java.security.AccessController.doPrivileged(Native Method)
> >> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >> >> >
> >> >> >
> >> >> >
> >> >> > I did a diff on the previous flume-ng script, copied it over and
> ran
> >> >> > bin/flume-ng without any such error. Here's the diff
> >> >> >
> >> >> > diff flume-ng flume-ng.PREVIOUS
> >> >> > 74c74
> >> >> > < java.library.path)
> >> >> > ---
> >> >> >> java.library.path 2>/dev/null)
> >> >> > 93c93
> >> >> > < HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath)
> >> >> > ---
> >> >> >> HADOOP_CLASSPATH=$($HADOOP_IN_PATH classpath 2>/dev/null)
> >> >> > 123c123
> >> >> > < java.library.path)
> >> >> > ---
> >> >> >> java.library.path 2>/dev/null)
> >> >> > 142c142
> >> >> > < HBASE_CLASSPATH=$($HBASE_IN_PATH classpath)
> >> >> > ---
> >> >> >> HBASE_CLASSPATH=$($HBASE_IN_PATH classpath 2>/dev/null)
> >> >> >
> >> >> >
> >> >> > Regards,
> >> >> >
> >> >> > Dano
> >> >>
> >> >> --
> >> >> Alexander Alten-Lorenz
> >> >> http://mapredit.blogspot.com
> >> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Apache MRUnit - Unit testing MapReduce -
> >> http://incubator.apache.org/mrunit/
> >
> >
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
