Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Use of Flume for the sensor network data


Copy link to this message
-
Re: Use of Flume for the sensor network data
Hi Mardan,

How did you install Flume in SLES? Are you installing Flume straight from
Apache, or from a distro?

Cheers,
Will

On Mon, Jul 23, 2012 at 4:46 PM, mardan Khan <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am still getting missing class error.
>
> I have specify the full path. My flume is installed in usr/lib/flume-ng
> and my configuration file is :/usr/lib/flume-ng/conf/flume.conf.
>
> you have mentioned that -c option with command, sorry i dont know exactly
> how I can use, I tried but give me the error message.
>
> I am apply the following command:
>
> $: /usr/bin/flume-ng agent -n agent -f /usr/lib/flume-ng/conf/flume.conf
>
>
> Could you please write me the exact command to override this problem.ch
>
> The configuration file exactly same you have posted,  just change the hdfs
> path and location of log file.
>
>
> For remind the error message as:
>
>
> 12/07/24 00:33:51 ERROR channel.ChannelProcessor: Builder class not found.
> Exception follows.
>
> java.lang.ClassNotFoundException:
> org.apache.flume.interceptor.HostInterceptor$Builder
>     at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>     at java.lang.Class.forName0(Native Method)
>
> I am really straggling to run one command successful
>
> Thanks
>
>
>
>
>
>
>
> On Mon, Jul 23, 2012 at 9:09 AM, Mohammad Tariq <[EMAIL PROTECTED]>wrote:
>
>> Hi mardan,
>>
>>      You need to use the -c option with tour command to specify the
>> directory where your configuration file is kept. Just look at the the
>> other thread of yours.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>> On Mon, Jul 23, 2012 at 10:19 AM, mardan Khan <[EMAIL PROTECTED]>
>> wrote:
>> > Dear Mohammad Tariq,
>> >
>> > Many thanks for your valuable information.
>> >
>> > For the testing purpose , i have installed flume on SuSE Linux system.
>> when
>> > i have type the command $/etc/init.d/flume-ng-agent start. Then i have
>> > receive message that Starting Flume NG agent daemon (flume-ng-agent):
>> >
>> > I think this mean my flume agent is working properly. I have the
>> following
>> > changes in configuration file according to your example. The
>> configuration
>> > file as:
>> >
>> >
>> >
>> > agent.sources = seqGenSrc
>> > agent.channels = memoryChannel
>> > agent.sinks = loggerSink
>> >
>> > # For each one of the sources, the type is defined
>> > agent.sources.seqGenSrc.type = seq
>> >
>> > # The channel can be defined as follows.
>> > agent.sources.seqGenSrc.channels = memoryChannel
>> >
>> > # Each sink's type must be defined
>> > agent.sinks.loggerSink.type = logger
>> >
>> > #Specify the channel the sink should use
>> > agent.sinks.loggerSink.channel = memoryChannel
>> >
>> > # Each channel's type is defined.
>> > agent.channels.memoryChannel.type = memory
>> >
>> > # Other config values specific to each type of channel(sink or source)
>> > # can be defined as well
>> > # In this case, it specifies the capacity of the memory channel
>> > agent.channels.memoryChannel.capacity = 100
>> >
>> >
>> > agent1.sources = tail
>> > agent1.channels = MemoryChannel-2
>> > agent1.sinks = HDFS
>> >
>> > agent1.sources.tail.type = exec
>> > agent1.sources.tail.command = tail -F /var/log/flume-ng/flume-init.log
>> >
>> > agent1.sources.tail.channels = MemoryChannel-2
>> >
>> > agent1.sources.tail.interceptors = hostint
>> > agent1.sources.tail.interceptors.hostint.type >> > org.apache.flume.interceptor.HostInterceptor$Builder
>> > agent1.sources.tail.interceptors.hostint.preserverExisting = true
>> >
>> > agent1.sources.tail.interceptors.hostint.useIP = true
>> >
>> > agent1.sinks.HDFS.channel = MemoryChannel-2
>> > agent1.channels.MemoryChannel-2.type = memory
>