Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> HDFS on 0.20.203


Copy link to this message
-
Re: HDFS on 0.20.203
Hi,

Thanks much!

It worked for both 0.20.203.0 and 0.21.0!

I am using Eclipse IDE. I tried once to use the plugin but it didn't work :(

Thanks & Regards
Arko

On Fri, Sep 2, 2011 at 12:21 AM, Sudharsan Sampath <[EMAIL PROTECTED]>wrote:

> Hi,
>
> Import o.a.h.conf . Also, if possible try and use an IDE so that u can
> avoid these kind of issues.
>
> - Sudhan S
>
> On Fri, Sep 2, 2011 at 10:35 AM, Arko Provo Mukherjee <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> Many thanks for your kind reply.
>>
>> I switched to 0.203.0 as per the advice of Arun Murthy.
>>
>> Also I replaced import org.apache.hadoop.*; by importorg.apache.hadoop.fs.*; as per the advice of Sudharsan.
>>
>> Now I get just one error:
>> FileTest.java:19: cannot find symbol
>> symbol  : class Configuration
>> location: class FileTest
>>                 FileSystem fs = FileSystem.get(new Configuration());
>>
>> Am I missing some other import statements?
>>
>> Many thanks in advance!
>> Warm Regards
>> Arko
>>
>> On Thu, Sep 1, 2011 at 11:42 PM, Sudharsan Sampath <[EMAIL PROTECTED]>wrote:
>>
>>> Hi,
>>>
>>> Some of your imports are incorrect. Both FileSystem and Path classes are
>>> present in o.a.h.fs
>>>
>>> Thanks
>>> Sudhan S
>>>
>>> On Thu, Sep 1, 2011 at 8:22 PM, Arko Provo Mukherjee <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hi,
>>>>
>>>> My code looks like this:
>>>>
>>>> *import java.util.*;*
>>>>
>>>> *import java.lang.*;*
>>>>
>>>> *import java.io.*;*
>>>>
>>>> *import org.apache.hadoop.*;*
>>>>
>>>> *
>>>> *
>>>>
>>>> *class MapReduce  {*
>>>>
>>>> *    *
>>>>
>>>> *public static void main(String[] args) throws Exception  {*
>>>>
>>>> **
>>>>
>>>> *        try  {*
>>>>
>>>> *                Path pt=new Path(
>>>> "hdfs://localhost:54310//Users/arko/Documents/Research/HDFS/abc");*
>>>>
>>>> *                FileSystem fs = FileSystem.get(new Configuration());*
>>>>
>>>> *                BufferedWriter br=new BufferedWriter(new
>>>>  OutputStreamWriter(fs.create(pt,true)));*
>>>>
>>>> *                String line;*
>>>>
>>>> *                line="Testing";*
>>>>
>>>> *                System.out.println(line);*
>>>>
>>>> *                br.write(line);*
>>>>
>>>> *                br.close();*
>>>>
>>>> *        }catch(Exception e){*
>>>>
>>>> *                System.out.println("File not found");*
>>>>
>>>> *        }*
>>>>
>>>> *    }*
>>>>
>>>> *}*
>>>>
>>>> When I compile the code, I get the following erros:
>>>> *$javac -classpath
>>>> /Users/arko/Documents/hadoop-0.21.0/hadoop-common-0.21.0.jar -d class/
>>>> FileSystemCat.java clear*
>>>>
>>>> FileTest.java:16: cannot find symbol
>>>> symbol  : class Path
>>>> location: class FileTest
>>>>                 Path pt=new
>>>> Path("hdfs://localhost:54310//Users/arko/Documents/Research/HDFS/abc");
>>>>                 ^
>>>> FileTest.java:16: cannot find symbol
>>>> symbol  : class Path
>>>> location: class FileTest
>>>>                 Path pt=new
>>>> Path("hdfs://localhost:54310//Users/arko/Documents/Research/HDFS/abc");
>>>>                             ^
>>>> FileTest.java:17: java.io.FileSystem is not public in java.io; cannot
>>>> be accessed from outside package
>>>>                 FileSystem fs = FileSystem.get(new Configuration());
>>>>                 ^
>>>> FileTest.java:17: cannot find symbol
>>>> symbol  : class Configuration
>>>> location: class FileTest
>>>>                 FileSystem fs = FileSystem.get(new Configuration());
>>>>                                                    ^
>>>> FileTest.java:17: java.io.FileSystem is not public in java.io; cannot
>>>> be accessed from outside package
>>>>                 FileSystem fs = FileSystem.get(new Configuration());
>>>>                                 ^
>>>> 5 errors
>>>>
>>>>
>>>> Also I would like to learn the FileContext API as I want to use 0.21 for
>>>> making appends to my file in each MR round.
>>>> Would be great if you have a place where I can have a look at some code
>>>> snippets that have demonstrated the use of FileContext for easy learning.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB