Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Re: Flume agent failure


Copy link to this message
-
Re: Flume agent failure
If you are using CDH then it's always better to uninstall the previous
version. If it is Apache Hadoop then it's just a matter of changing
the directory.

Regards,
    Mohammad Tariq
On Thu, Jul 5, 2012 at 5:28 PM, vijay k <[EMAIL PROTECTED]> wrote:
> Hi,
>
> with out removing older version, shall i install hadoop 0.20.204 in another
> folder?
>
> Thanks,
> vijay
>
> On Wed, Jul 4, 2012 at 7:26 PM, alo alt <[EMAIL PROTECTED]> wrote:
>>
>> Yes.
>>
>> Follow these link:
>> http://hadoop.apache.org/common/docs/r0.20.204.0/
>>
>> to install a single node or cluster. Note, you need on the sink side the
>> same hdfs version as you've in your cluster.
>>
>> - Alex
>>
>>
>> On Jul 4, 2012, at 3:51 PM, vijay k wrote:
>>
>> > I have already downloaded the hadoop-0.20.204.0.tar.gz,
>> >
>> > shall i go ahead  with hadoop 0.20.204 ver installation. please confirm
>> > it
>> > is compatible with flume 1.2.0 version?
>> >
>> > Thanks,
>> > Vijay
>> >
>> > On Wed, Jul 4, 2012 at 7:03 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >
>> >> 1. Flume uses the libs from the classpath
>> >> 2. remove the installed hadoop version (apt-get remove hadoop*)
>> >> 3. http://hadoop.apache.org/common/docs/   => click at the version you
>> >> want to install and follow the steps described there
>> >>
>> >> - Alex
>> >>
>> >> On Jul 4, 2012, at 2:36 PM, vijay k wrote:
>> >>
>> >>> Hi Alex,
>> >>>
>> >>> I have installed hadoop via tar xzf hadoop-0.20.2.zip in Ubuntu, but i
>> >>> could not able to find the *hadoop-install* directory.
>> >>> Please let me know the following query's
>> >>>
>> >>> 1. which latest HADOOP version is compatible with FLUME 1.2.0 .
>> >>> 2. if need to remove my hadoop 0.20.0 version, how to remove the older
>> >>> version.
>> >>> 3. and provide the hadoop latest version installation steps.
>> >>>
>> >>> Thanks a lot for your comments.
>> >>>
>> >>>
>> >>>
>> >>> On Wed, Jul 4, 2012 at 5:28 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >>>
>> >>>> U're on Ubuntu / Debian?
>> >>>>
>> >>>> If yes, remove the hadoop installation via apt, you have an really
>> >>>> old
>> >> one
>> >>>> installed. Take a look into the /usr/local/hadoop/lib directory (as
>> >>>> you
>> >>>> posted before):
>> >>>>
>> >>>> -rw-r--r-- 1 hduser hadoop   15010 2010-02-19 13:25 xmlenc-0.52.jar
>> >>>> -rw-r--r-- 1 hduser hadoop    8601 2010-02-19 13:25
>> >> slf4j-log4j12-1.4.3.jar
>> >>>>
>> >>>> and so on. From 2010 - pretty old.
>> >>>>
>> >>>> How do you installed hadoop? I think you've done already from the
>> >> tarball
>> >>>> into /hadoop-install/hadoop - there should be a ../lib dir too.
>> >>>> Export
>> >>>> these and try again.
>> >>>>
>> >>>> - Alex
>> >>>>
>> >>>>
>> >>>> On Jul 4, 2012, at 1:50 PM, vijay k wrote:
>> >>>>
>> >>>>> Hi Alex,
>> >>>>>
>> >>>>> I have set the HADOOP_CLASSPATH=/usr/local/hadoop/lib only, but
>> >>>>> still
>> >> am
>> >>>>> unable to proceed further.
>> >>>>> Please find the attached flume-ng script. Please guide me if i did
>> >>>> anything
>> >>>>> wrong in the script
>> >>>>>
>> >>>>> Thanks a lot for your helping to proceed further.
>> >>>>>
>> >>>>>
>> >>>>> On Wed, Jul 4, 2012 at 5:08 PM, alo alt <[EMAIL PROTECTED]> wrote:
>> >>>>>
>> >>>>>> Hi Vijay,
>> >>>>>>
>> >>>>>> but you've set the path to:
>> >>>>>>> hadoop classpath        -- /usr/local/hadoop/bin/hadoop
>> >>>>>>
>> >>>>>> should be: /usr/local/hadoop/lib
>> >>>>>>
>> >>>>>> Flume reads out the variable and look into that path for all needed
>> >>>>>> classes / jars. But in /usr/local/hadoop/bin/hadoop flume found
>> >> nothing.
>> >>>>>>
>> >>>>>> - Alex
>> >>>>>>
>> >>>>>>
>> >>>>>> On Jul 4, 2012, at 1:33 PM, vijay k wrote:
>> >>>>>>
>> >>>>>>> Hi Alex,
>> >>>>>>>
>> >>>>>>> Hadoop lib are installed following path
>> >>>>>>>
>> >>>>>>> root@md-trngpoc1
>> >>>>>> :/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/bin#
>> >>>>>>> cd /usr/local/hadoop/lib
>> >>>>>>> root@md-trngpoc1:/usr/local/hadoop/lib# ls -lrt
>> >>>>>>> total 8428
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB