Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - Re: Flume agent failure
vijay k
2012-07-02, 07:11
Mike Percy
2012-07-03, 16:44
ankul rastogi
2012-07-03, 17:49
vijay k
2012-07-04, 10:05
alo alt
2012-07-04, 10:21
vijay k
2012-07-04, 11:33
alo alt
2012-07-04, 11:38
vijay k
2012-07-04, 11:50
alo alt
2012-07-04, 11:58
vijay k
2012-07-04, 12:36
alo alt
2012-07-04, 13:33
vijay k
2012-07-04, 13:51
alo alt
2012-07-04, 13:56
vijay k
2012-07-05, 11:58
Mike Percy
2012-07-05, 18:41
vijay k
2012-07-06, 06:59
Copy link to this message
-
Re: Flume agent failure
Mohammad Tariq 2012-07-05, 12:08
If you are using CDH then it's always better to uninstall the previous
version. If it is Apache Hadoop then it's just a matter of changing
the directory.

Regards,
    Mohammad Tariq
On Thu, Jul 5, 2012 at 5:28 PM, vijay k <[EMAIL PROTECTED]> wrote:
> Hi,
>
> with out removing older version, shall i install hadoop 0.20.204 in another
> folder?
>
> Thanks,
> vijay
>
> On Wed, Jul 4, 2012 at 7:26 PM, alo alt <[EMAIL PROTECTED]> wrote:
>>
>> Yes.
>>
>> Follow these link:
>> http://hadoop.apache.org/common/docs/r0.20.204.0/
>>
>> to install a single node or cluster. Note, you need on the sink side the
>> same hdfs version as you've in your cluster.
>>
>> - Alex
>>
>>
>> On Jul 4, 2012, at 3:51 PM, vijay k wrote:
>>
>> > I have already downloaded the hadoop-0.20.204.0.tar.gz,
>> >
>> > shall i go ahead  with hadoop 0.20.204 ver installation. please confirm
>> > it
>> > is compatible with flume 1.2.0 version?
>> >
>> > Thanks,
>> > Vijay
>> >
>> > On Wed, Jul 4, 2012 at 7:03 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >
>> >> 1. Flume uses the libs from the classpath
>> >> 2. remove the installed hadoop version (apt-get remove hadoop*)
>> >> 3. http://hadoop.apache.org/common/docs/   => click at the version you
>> >> want to install and follow the steps described there
>> >>
>> >> - Alex
>> >>
>> >> On Jul 4, 2012, at 2:36 PM, vijay k wrote:
>> >>
>> >>> Hi Alex,
>> >>>
>> >>> I have installed hadoop via tar xzf hadoop-0.20.2.zip in Ubuntu, but i
>> >>> could not able to find the *hadoop-install* directory.
>> >>> Please let me know the following query's
>> >>>
>> >>> 1. which latest HADOOP version is compatible with FLUME 1.2.0 .
>> >>> 2. if need to remove my hadoop 0.20.0 version, how to remove the older
>> >>> version.
>> >>> 3. and provide the hadoop latest version installation steps.
>> >>>
>> >>> Thanks a lot for your comments.
>> >>>
>> >>>
>> >>>
>> >>> On Wed, Jul 4, 2012 at 5:28 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >>>
>> >>>> U're on Ubuntu / Debian?
>> >>>>
>> >>>> If yes, remove the hadoop installation via apt, you have an really
>> >>>> old
>> >> one
>> >>>> installed. Take a look into the /usr/local/hadoop/lib directory (as
>> >>>> you
>> >>>> posted before):
>> >>>>
>> >>>> -rw-r--r-- 1 hduser hadoop   15010 2010-02-19 13:25 xmlenc-0.52.jar
>> >>>> -rw-r--r-- 1 hduser hadoop    8601 2010-02-19 13:25
>> >> slf4j-log4j12-1.4.3.jar
>> >>>>
>> >>>> and so on. From 2010 - pretty old.
>> >>>>
>> >>>> How do you installed hadoop? I think you've done already from the
>> >> tarball
>> >>>> into /hadoop-install/hadoop - there should be a ../lib dir too.
>> >>>> Export
>> >>>> these and try again.
>> >>>>
>> >>>> - Alex
>> >>>>
>> >>>>
>> >>>> On Jul 4, 2012, at 1:50 PM, vijay k wrote:
>> >>>>
>> >>>>> Hi Alex,
>> >>>>>
>> >>>>> I have set the HADOOP_CLASSPATH=/usr/local/hadoop/lib only, but
>> >>>>> still
>> >> am
>> >>>>> unable to proceed further.
>> >>>>> Please find the attached flume-ng script. Please guide me if i did
>> >>>> anything
>> >>>>> wrong in the script
>> >>>>>
>> >>>>> Thanks a lot for your helping to proceed further.
>> >>>>>
>> >>>>>
>> >>>>> On Wed, Jul 4, 2012 at 5:08 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >>>>>
>> >>>>>> Hi Vijay,
>> >>>>>>
>> >>>>>> but you've set the path to:
>> >>>>>>> hadoop classpath        -- /usr/local/hadoop/bin/hadoop
>> >>>>>>
>> >>>>>> should be: /usr/local/hadoop/lib
>> >>>>>>
>> >>>>>> Flume reads out the variable and look into that path for all needed
>> >>>>>> classes / jars. But in /usr/local/hadoop/bin/hadoop flume found
>> >> nothing.
>> >>>>>>
>> >>>>>> - Alex
>> >>>>>>
>> >>>>>>
>> >>>>>> On Jul 4, 2012, at 1:33 PM, vijay k wrote:
>> >>>>>>
>> >>>>>>> Hi Alex,
>> >>>>>>>
>> >>>>>>> Hadoop lib are installed following path
>> >>>>>>>
>> >>>>>>> root@md-trngpoc1
>> >>>>>> :/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/bin#
>> >>>>>>> cd /usr/local/hadoop/lib
>> >>>>>>> root@md-trngpoc1:/usr/local/hadoop/lib# ls -lrt
>> >>>>>>> total 8428
>