Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> what are the libraries needed for flume log4jappender


+
yogender nerella 2013-01-23, 18:02
+
Mike Percy 2013-01-23, 19:36
+
yogi nerella 2013-01-23, 19:51
+
Mike Percy 2013-01-23, 19:54
Copy link to this message
-
Re: what are the libraries needed for flume log4jappender
Mike,

I am importing the project into eclipse using maven, but the project has
issues in the legacy-sources module.

Description Resource Path Location Type
AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java
/flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java Problem
Runtime issues are with 1.3.1
1.   If I include just ng-core, I run into issues of FlumeException not
found.

Classpath:
C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar
log4j:WARN Error during default initialization
java.lang.NoClassDefFoundError: org/apache/flume/FlumeException
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Unknown Source)
at java.lang.Class.getConstructor0(Unknown Source)
at java.lang.Class.newInstance0(Unknown Source)
2.   If I include ng-core, and ng-sdk, I run into the following exception.
Classpath:
C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-sdk-1.3.1.jar
log4j:WARN Error during default initialization
java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory
at
org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:168)
at
org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
at
org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:184)
Appreciate your help,
Yogi

On Wed, Jan 23, 2013 at 11:54 AM, Mike Percy <[EMAIL PROTECTED]> wrote:

> Yogi, Flume has lots of dependencies. You can't just drop in one jar. That
> is what Maven is for.
>
> Regards
> Mike
>
>
> On Wed, Jan 23, 2013 at 11:51 AM, yogi nerella <[EMAIL PROTECTED]>wrote:
>
>> HI,
>>
>> I have tried the 1.3.0 and ran into issues, so I am building from the
>> latest source and still has the same issue.
>>
>> Yogi
>>
>>
>> On Wed, Jan 23, 2013 at 11:36 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>
>>> What version of Flume are you using? Are you using Maven for your build?
>>>
>>> You should be able to get away with just flume-ng-core.
>>>
>>>
>>> On Wed, Jan 23, 2013 at 10:02 AM, yogender nerella <[EMAIL PROTECTED]>wrote:
>>>
>>>> Hi,
>>>>
>>>> I would like to make my app directly write events to an flume agent.
>>>>
>>>> What are the libraries needed to add into my application?
>>>>
>>>> I have tried to add the following three but runs into class not found
>>>> errors.
>>>>
>>>>
>>>> log4j.properties are as follows:
>>>>
>>>>
>>>> log4j.rootLogger=TRACE, flume
>>>> log4j.appender.flume >>>> org.apache.flume.clients.log4jappender.Log4jAppender
>>>> log4j.appender.flume.Hostname = example.com
>>>> log4j.appender.flume.Port = 44444
>>>> log4j.appender.flume.layout=org.apache.log4j.TTCCLayout
>>>>
>>>>
>>>> Error In Initialization
>>>>
>>>> Classpath:
>>>> C:\\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\test\flume\flume-ng-core-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-log4jappender-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-sdk-1.4.0-SNAPSHOT.jar
>>>> log4j:WARN Error during default initialization
>>>> java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory
>>>> at
>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:168)
>>>>  at
>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
>>>> at
>>>> org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:195)
>>>>  at
>>>> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
>>>> at
>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
>>>>  at
>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
+
Mike Percy 2013-01-23, 20:08
+
yogi nerella 2013-01-23, 20:24
+
Mike Percy 2013-01-23, 20:44
+
Arvind Prabhakar 2013-01-23, 21:17
+
yogi nerella 2013-01-23, 21:39
+
Arvind Prabhakar 2013-01-23, 22:06
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB