Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> what are the libraries needed for flume log4jappender


+
yogender nerella 2013-01-23, 18:02
+
Mike Percy 2013-01-23, 19:36
+
yogi nerella 2013-01-23, 19:51
+
Mike Percy 2013-01-23, 19:54
+
yogi nerella 2013-01-23, 20:03
+
Mike Percy 2013-01-23, 20:08
+
yogi nerella 2013-01-23, 20:24
+
Mike Percy 2013-01-23, 20:44
+
Arvind Prabhakar 2013-01-23, 21:17
+
yogi nerella 2013-01-23, 21:39
Copy link to this message
-
Re: what are the libraries needed for flume log4jappender
I used the standard maven dependency plugin to get this information.

$ mvn dependency:tree

This will list out all the dependencies no matter what their scope is. But
you can safely ignore dependencies that have a test scope.

Regards,
Arvind Prabhakar

On Wed, Jan 23, 2013 at 1:39 PM, yogi nerella <[EMAIL PROTECTED]> wrote:

> Arvind,
>
> Thanks for the information, is there any dependency walker tool or do we
> have to do this manually?
> I have gone thru the pom.xml, which lists junit and others also as
> dependency, so how to avoid some of them which are unnecessary.
>
> Yogi
>
>
> On Wed, Jan 23, 2013 at 1:17 PM, Arvind Prabhakar <[EMAIL PROTECTED]>wrote:
>
>> Here are the dependencies that maven shows for Flume's log4j appender
>> (generated from the 1.3.0 branch):
>>
>> org.apache.flume.flume-ng-clients:flume-ng-log4jappender:jar:1.3.1:
>>
>>    - log4j:log4j:jar:1.2.16
>>    - org.apache.flume:flume-ng-sdk:jar:1.3.1
>>       - org.apache.avro:avro:jar:1.7.2
>>          - org.codehaus.jackson:jackson-core-asl:jar:1.9.3
>>          - org.codehaus.jackson:jackson-mapper-asl:jar:1.9.3
>>          - com.thoughtworks.paranamer:paranamer:jar:2.3
>>          - org.xerial.snappy:snappy-java:jar:1.0.4.1
>>          - org.slf4j:slf4j-api:jar:1.6.1
>>       -  org.apache.avro:avro-ipc:jar:1.7.2
>>          - org.mortbay.jetty:jetty:jar:6.1.26
>>          - org.mortbay.jetty:jetty-util:jar:6.1.26
>>          - org.apache.velocity:velocity:jar:1.7
>>             - commons-collections:commons-collections:jar:3.2.1
>>             - commons-lang:commons-lang:jar:2.5
>>          - io.netty:netty:jar:3.4.0.Final
>>
>>
>> Regards,
>> Arvind Prabhakar
>>
>> On Wed, Jan 23, 2013 at 12:44 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>
>>> If you want only the required library files, use Maven to pull in the
>>> exact set of dependencies.
>>>
>>>
>>> On Wed, Jan 23, 2013 at 12:24 PM, yogi nerella <[EMAIL PROTECTED]>wrote:
>>>
>>>> Mike,
>>>>
>>>> When I include all the libraries it is not giving compilation problem,
>>>> but log4jappender documentation says it only needs flume-ng-sdk.jar file.
>>>>
>>>> In that case, if I want to ship flume log4jappender, should I have to
>>>> ship all these jar files in flume/lib directory?
>>>>
>>>> Yogi
>>>>
>>>>
>>>> On Wed, Jan 23, 2013 at 12:08 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>>
>>>>> I don't use Eclipse but my understanding is that mvn eclipse:eclipse
>>>>> will create a usable Eclipse project file which you can import. the
>>>>> AvroFlumeEvent class is automatically generated at build time by the maven
>>>>> avro compiler.
>>>>>
>>>>> If you want to avoid maven entirely, you have the option of pulling in
>>>>> all the jar files in the lib directory of the Flume binary archive. Those
>>>>> are all the dependencies Flume needs to run.
>>>>>
>>>>> Hope that helps!
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Jan 23, 2013 at 12:03 PM, yogi nerella <[EMAIL PROTECTED]>wrote:
>>>>>
>>>>>> Mike,
>>>>>>
>>>>>> I am importing the project into eclipse using maven, but the project
>>>>>> has issues in the legacy-sources module.
>>>>>>
>>>>>> Description Resource Path Location Type
>>>>>> AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java
>>>>>> /flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java
>>>>>> Problem
>>>>>>
>>>>>>
>>>>>> Runtime issues are with 1.3.1
>>>>>> 1.   If I include just ng-core, I run into issues of FlumeException
>>>>>> not found.
>>>>>>
>>>>>> Classpath:
>>>>>> C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar
>>>>>>  log4j:WARN Error during default initialization
>>>>>> java.lang.NoClassDefFoundError: org/apache/flume/FlumeException
>>>>>> at java.lang.Class.getDeclaredConstructors0(Native Method)
>>>>>>  at java.lang.Class.privateGetDeclaredConstructors(Unknown Source)
>>>>>> at java.lang.Class.getConstructor0(Unknown Source)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB