Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: issue about try lzo in hadoop


Copy link to this message
-
Re: issue about try lzo in hadoop
i installed
hadoop-0.20-mapreduce-2.0.0+1357-1.cdh4.3.0.p0.21.el6.x86_64,and now ok,
question is test code use MRV1,not YARN?
On Tue, Aug 6, 2013 at 3:27 PM, Sandeep Nemuri <[EMAIL PROTECTED]> wrote:

> send me your conf file .
>
>
> On Tue, Aug 6, 2013 at 12:09 PM, ch huang <[EMAIL PROTECTED]> wrote:
>
>> i use yarn ,and hadoop version is CDH4.3, lzo installed,but when i run
>> test ,it failed,why?
>>
>> # sudo -u hdfs hadoop jar
>> /usr/lib/hadoop/lib/hadoop-lzo-cdh4-0.4.15-gplextras.jar
>> com.hadoop.compression.lzo.LzoIndexer /test
>> 13/08/06 22:28:03 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
>> 13/08/06 22:28:03 INFO lzo.LzoCodec: Successfully loaded & initialized
>> native-lzo library [hadoop-lzo rev 6298911ef75545c61859c08add6a74a83e0183ad]
>> 13/08/06 22:28:04 INFO lzo.LzoIndexer: LZO Indexing directory /test...
>> 13/08/06 22:28:04 INFO lzo.LzoIndexer:   [INDEX] LZO Indexing file
>> hdfs://mycluster/test/install.log.lzo, size 0.00 GB...
>> 13/08/06 22:28:04 WARN conf.Configuration: hadoop.native.lib is
>> deprecated. Instead, use io.native.lib.available
>> 13/08/06 22:28:04 INFO lzo.LzoIndexer:   Completed LZO Indexing in 0.18
>> seconds (0.05 MB/s).  Index size is 0.01 KB.
>> [root@node1 ~]# echo $?
>> 0
>> ]# sudo -u hdfs hadoop jar
>> /usr/lib/hadoop/lib/hadoop-lzo-cdh4-0.4.15-gplextras.jar
>> com.hadoop.compression.lzo.DistributedLzoIndexer /test
>> 13/08/06 22:30:34 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
>> 13/08/06 22:30:34 INFO lzo.LzoCodec: Successfully loaded & initialized
>> native-lzo library [hadoop-lzo rev 6298911ef75545c61859c08add6a74a83e0183ad]
>> 13/08/06 22:30:35 INFO lzo.DistributedLzoIndexer: Adding LZO file
>> hdfs://mycluster/test/install.log.lzo to indexing list (no index currently
>> exists)
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>> org/apache/hadoop/mapreduce/Job
>>         at
>> com.hadoop.compression.lzo.DistributedLzoIndexer.run(DistributedLzoIndexer.java:90)
>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>>         at
>> com.hadoop.compression.lzo.DistributedLzoIndexer.main(DistributedLzoIndexer.java:115)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:601)
>>         at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.mapreduce.Job
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
>>         ... 9 more
>>
>
>
>
> --
> --Regards
>   Sandeep Nemuri
>