Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> error:Caused by: java.lang.ClassNotFoundException:  com.hadoop.compression.lzo.LzopCodec


Copy link to this message
-
Re: error:Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzopCodec
Yes.

On Thu, Jul 29, 2010 at 7:57 AM, Alex Luya <[EMAIL PROTECTED]> wrote:

> Hi,
>
>    Run:ps -aef | grep -i tasktracker
> I got this:
>
> -------------------------------------------------------------------------------------------------
> alex      2425     1  0 22:34 ?        00:00:05
> /usr/local/hadoop/jdk1.6.0_20/bin/java -Xmx200m -
> Dhadoop.log.dir=/usr/local/hadoop/hadoop-0.20.2/bin/../logs -
> Dhadoop.log.file=hadoop-alex-tasktracker-Hadoop-03.log -
> Dhadoop.home.dir=/usr/local/hadoop/hadoop-0.20.2/bin/..
> -Dhadoop.id.str=alex -
> Dhadoop.root.logger=INFO,DRFA -
> Djava.library.path=/usr/local/hadoop/hadoop-0.20.2/bin/../lib/native/Linux-
> amd64-64 -Dhadoop.policy.file=hadoop-policy.xml -classpath
>
> /usr/local/hadoop/hadoop-0.20.2/bin/../conf:/usr/local/hadoop/jdk1.6.0_20/lib/tools.jar:/usr/local/hadoop/hadoop-0.20.2/bin/..:/usr/local/hadoop/hadoop-0.20.2/bin/../hadoop-0.20.2-
> core.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
> cli-1.2.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
> codec-1.3.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
> el-1.0.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
> httpclient-3.0.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
>
> logging-1.0.4.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-logging-
> api-1.0.4.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/commons-
>
> net-1.4.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/core-3.1.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/hadoop-
>
> lzo-0.4.4.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jasper-
> compiler-5.5.12.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jasper-
>
> runtime-5.5.12.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jetty-6.1.14.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jetty-
>
> util-6.1.14.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/junit-3.8.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/kfs-0.2.2.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/log4j-1.2.15.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/mockito-
>
> all-1.8.0.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/oro-2.0.8.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/servlet-
> api-2.5-6.1.14.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/slf4j-
> api-1.4.3.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/slf4j-
>
> log4j12-1.4.3.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/xmlenc-0.52.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop/hadoop-0.20.2/bin/../lib/jsp-2.1/jsp-
> api-2.1.jar org.apache.hadoop.mapred.TaskTracker
> alex      2609  1231  0 22:51 pts/0    00:00:00 grep --color=auto -i
> tasktracker
>
> -----------------------------------------------------------------------------------------------------------------------------------------------------
>
>
> see this:
> :/usr/local/hadoop/hadoop-0.20.2/bin/../lib/hadoop-lzo-0.4.4.jar
>
> "hadoop-lzo-0.4.4.jar" got presented,but question is why directory
> structure
> will like this "/bin/../lib/hadoop-lzo-0.4.4.jar",it should be
> "/usr/local/hadoop/hadoop-0.20.2/lib/hadoop-lzo-0.4.4.jar",is this normal?
>
>
> On Thursday, July 29, 2010 07:34:45 am Alex Kozlov wrote:
> > Hi Alex,
> >
> > There seems to be a problem with your configuration.  Can you try and
> check
> > on which node the attempt_201007202234_0001_m_000000_0 was run?  Go to
> this
> > machine and check the config files and the lib subdirectory (for the
> > presence of the correct configuration and the hadoop-lzo-0.4.4.jar).
> > Restart the TT and using 'ps -aef | grep -i tasktracker' check that the
> > hadoop-lzo-0.4.4.jar is in the classpath.
> >
> > I have a strong suspicion you have stray config files:
> > com.hadoop.compression.lzo.LzopCodec is not mentioned in the ones you
> > provided...
> >
> > Alex K
> >
> > On Wed, Jul 28, 2010 at 7:42 AM, Alex Luya <[EMAIL PROTECTED]>
> wrote: