Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> what are the libraries needed for flume log4jappender


+
yogender nerella 2013-01-23, 18:02
+
Mike Percy 2013-01-23, 19:36
+
yogi nerella 2013-01-23, 19:51
+
Mike Percy 2013-01-23, 19:54
+
yogi nerella 2013-01-23, 20:03
+
Mike Percy 2013-01-23, 20:08
+
yogi nerella 2013-01-23, 20:24
Copy link to this message
-
Re: what are the libraries needed for flume log4jappender
If you want only the required library files, use Maven to pull in the exact
set of dependencies.
On Wed, Jan 23, 2013 at 12:24 PM, yogi nerella <[EMAIL PROTECTED]>wrote:

> Mike,
>
> When I include all the libraries it is not giving compilation problem, but
> log4jappender documentation says it only needs flume-ng-sdk.jar file.
>
> In that case, if I want to ship flume log4jappender, should I have to ship
> all these jar files in flume/lib directory?
>
> Yogi
>
>
> On Wed, Jan 23, 2013 at 12:08 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>
>> I don't use Eclipse but my understanding is that mvn eclipse:eclipse will
>> create a usable Eclipse project file which you can import. the
>> AvroFlumeEvent class is automatically generated at build time by the maven
>> avro compiler.
>>
>> If you want to avoid maven entirely, you have the option of pulling in
>> all the jar files in the lib directory of the Flume binary archive. Those
>> are all the dependencies Flume needs to run.
>>
>> Hope that helps!
>>
>>
>>
>> On Wed, Jan 23, 2013 at 12:03 PM, yogi nerella <[EMAIL PROTECTED]>wrote:
>>
>>> Mike,
>>>
>>> I am importing the project into eclipse using maven, but the project has
>>> issues in the legacy-sources module.
>>>
>>> Description Resource Path Location Type
>>> AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java
>>> /flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java Problem
>>>
>>>
>>> Runtime issues are with 1.3.1
>>> 1.   If I include just ng-core, I run into issues of FlumeException not
>>> found.
>>>
>>> Classpath:
>>> C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar
>>>  log4j:WARN Error during default initialization
>>> java.lang.NoClassDefFoundError: org/apache/flume/FlumeException
>>> at java.lang.Class.getDeclaredConstructors0(Native Method)
>>>  at java.lang.Class.privateGetDeclaredConstructors(Unknown Source)
>>> at java.lang.Class.getConstructor0(Unknown Source)
>>>  at java.lang.Class.newInstance0(Unknown Source)
>>>
>>>
>>> 2.   If I include ng-core, and ng-sdk, I run into the following
>>> exception.
>>> Classpath:
>>> C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-sdk-1.3.1.jar
>>>  log4j:WARN Error during default initialization
>>> java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory
>>> at
>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:168)
>>>  at
>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
>>> at
>>> org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:184)
>>>
>>>
>>> Appreciate your help,
>>> Yogi
>>>
>>>
>>>
>>> On Wed, Jan 23, 2013 at 11:54 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>
>>>> Yogi, Flume has lots of dependencies. You can't just drop in one jar.
>>>> That is what Maven is for.
>>>>
>>>> Regards
>>>> Mike
>>>>
>>>>
>>>> On Wed, Jan 23, 2013 at 11:51 AM, yogi nerella <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> HI,
>>>>>
>>>>> I have tried the 1.3.0 and ran into issues, so I am building from the
>>>>> latest source and still has the same issue.
>>>>>
>>>>> Yogi
>>>>>
>>>>>
>>>>> On Wed, Jan 23, 2013 at 11:36 AM, Mike Percy <[EMAIL PROTECTED]>wrote:
>>>>>
>>>>>> What version of Flume are you using? Are you using Maven for your
>>>>>> build?
>>>>>>
>>>>>> You should be able to get away with just flume-ng-core.
>>>>>>
>>>>>>
>>>>>> On Wed, Jan 23, 2013 at 10:02 AM, yogender nerella <
>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I would like to make my app directly write events to an flume agent.
>>>>>>>
>>>>>>> What are the libraries needed to add into my application?
+
Arvind Prabhakar 2013-01-23, 21:17
+
yogi nerella 2013-01-23, 21:39
+
Arvind Prabhakar 2013-01-23, 22:06