Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> what are the libraries needed for flume log4jappender


+
yogender nerella 2013-01-23, 18:02
+
Mike Percy 2013-01-23, 19:36
+
yogi nerella 2013-01-23, 19:51
+
Mike Percy 2013-01-23, 19:54
Copy link to this message
-
Re: what are the libraries needed for flume log4jappender
Mike,

I am importing the project into eclipse using maven, but the project has
issues in the legacy-sources module.

Description Resource Path Location Type
AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java
/flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java Problem
Runtime issues are with 1.3.1
1.   If I include just ng-core, I run into issues of FlumeException not
found.

Classpath:
C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar
log4j:WARN Error during default initialization
java.lang.NoClassDefFoundError: org/apache/flume/FlumeException
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Unknown Source)
at java.lang.Class.getConstructor0(Unknown Source)
at java.lang.Class.newInstance0(Unknown Source)
2.   If I include ng-core, and ng-sdk, I run into the following exception.
Classpath:
C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-sdk-1.3.1.jar
log4j:WARN Error during default initialization
java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory
at
org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:168)
at
org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
at
org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:184)
Appreciate your help,
Yogi

On Wed, Jan 23, 2013 at 11:54 AM, Mike Percy <[EMAIL PROTECTED]> wrote:

> Yogi, Flume has lots of dependencies. You can't just drop in one jar. That
> is what Maven is for.
>
> Regards
> Mike
>
>
> On Wed, Jan 23, 2013 at 11:51 AM, yogi nerella <[EMAIL PROTECTED]>wrote:
>
>> HI,
>>
>> I have tried the 1.3.0 and ran into issues, so I am building from the
>> latest source and still has the same issue.
>>
>> Yogi
>>
>>
>> On Wed, Jan 23, 2013 at 11:36 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>
>>> What version of Flume are you using? Are you using Maven for your build?
>>>
>>> You should be able to get away with just flume-ng-core.
>>>
>>>
>>> On Wed, Jan 23, 2013 at 10:02 AM, yogender nerella <[EMAIL PROTECTED]>wrote:
>>>
>>>> Hi,
>>>>
>>>> I would like to make my app directly write events to an flume agent.
>>>>
>>>> What are the libraries needed to add into my application?
>>>>
>>>> I have tried to add the following three but runs into class not found
>>>> errors.
>>>>
>>>>
>>>> log4j.properties are as follows:
>>>>
>>>>
>>>> log4j.rootLogger=TRACE, flume
>>>> log4j.appender.flume >>>> org.apache.flume.clients.log4jappender.Log4jAppender
>>>> log4j.appender.flume.Hostname = example.com
>>>> log4j.appender.flume.Port = 44444
>>>> log4j.appender.flume.layout=org.apache.log4j.TTCCLayout
>>>>
>>>>
>>>> Error In Initialization
>>>>
>>>> Classpath:
>>>> C:\\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\test\flume\flume-ng-core-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-log4jappender-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-sdk-1.4.0-SNAPSHOT.jar
>>>> log4j:WARN Error during default initialization
>>>> java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory
>>>> at
>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:168)
>>>>  at
>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
>>>> at
>>>> org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:195)
>>>>  at
>>>> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
>>>> at
>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
>>>>  at
>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
+
Mike Percy 2013-01-23, 20:08
+
yogi nerella 2013-01-23, 20:24
+
Mike Percy 2013-01-23, 20:44
+
Arvind Prabhakar 2013-01-23, 21:17
+
yogi nerella 2013-01-23, 21:39
+
Arvind Prabhakar 2013-01-23, 22:06