Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Hello and request some advice.


+
Nitin Pawar 2013-01-04, 17:45
+
John Lilley 2013-01-04, 18:12
+
Rajeev Yadav 2013-01-04, 19:18
+
John Lilley 2013-01-04, 19:27
+
Michael Segel 2013-01-04, 19:53
+
Glen Mazza 2013-01-04, 21:46
+
Gangadhar Ramini 2013-01-04, 17:50
+
Nitin Pawar 2013-01-04, 17:55
+
Gangadhar Ramini 2013-01-04, 18:04
+
Nitin Pawar 2013-01-04, 18:19
Copy link to this message
-
Re: Hello and request some advice.
Gangadhar Ramini 2013-01-04, 18:51
Following is the configuration i put in config.
core-site.xml

  <property>
    <name>hadoop.tmp.dir</name>
    <value>/usr/local/hadoop/datastore/hadoop-${user.name}</value>
  </property>

hdfs-site.xml

 <property>
    <name>dfs.name.dir</name>
    <value>C:/cygwin/dfs/logs</value>
 </property>
 <property>
    <name>dfs.data.dir</name>
    <value>C:/cygwin/dfs/data</value>
 </property>

Thanks
-Gangadhar
On Fri, Jan 4, 2013 at 10:19 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:

> what about other directories like hdfs directories and tmp directories ?
>
>
> On Fri, Jan 4, 2013 at 11:34 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote:
>
>> Yes user owns the directory and had right permissions, still i don't
>> understand what could be the issue.
>>
>>
>> ls -ltr ~/hadoop-1.0.4/logs/history
>> total 0
>> drwxr-xr-x+ 1 garamini mkgroup 0 Jan  2 22:15
>>
>> Thanks
>> -Gangadhar
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Jan 4, 2013 at 9:55 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>>
>>> Does your user have permissions to read/write on the dfs directories you
>>> made?
>>>
>>> try changing the directory ownerships to the user which is running
>>> hadoop.
>>>
>>>
>>> On Fri, Jan 4, 2013 at 11:20 PM, Gangadhar Ramini <[EMAIL PROTECTED]>wrote:
>>>
>>>> Hi Nitin,
>>>>
>>>>    I tried latest stable Hadoop version on windows with cygwin, I see
>>>> following error in JobTracker logs. Do you have any advice?
>>>>
>>>>  C:\cygwin\home\garamini\hadoop-1.0.4\logs\history to 0755^M
>>>>         at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689)^M
>>>>         at
>>>> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:670)^M
>>>>         at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)^M
>>>>         at
>>>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)^M
>>>>         at
>>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:510)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2334)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:2331)^M
>>>>         at java.security.AccessController.doPrivileged(Native Method)^M
>>>>         at javax.security.auth.Subject.doAs(Subject.java:415)^M
>>>>         at
>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2331)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)^M
>>>>         at
>>>> org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)^M
>>>> Thanks
>>>> -Gangadhar
>>>>
>>>>
>>>> On Fri, Jan 4, 2013 at 9:45 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> - Is Ubuntu a good O.S. for running Hadoop?  I’ve tried to learn in
>>>>> the past using Red Hat & Infosphere Biginsights, but I need a free O.S.
>>>>> If you want a free O.S , ubuntu is good but if you are familiar with
>>>>> RedHat then you may want to have look at Scientific Linux (Its free as well)
>>>>>
>>>>> - Is there a way to learn Hadoop without a static IP address? That was
>>>>> really a problem for me when dealing with Infosphere, since I travel
>>>>> frequently.
>>>>> If you got a laptop with you then thats all you need to learn hadoop.
>>>>> Hadoop can be installed in a pseudo distributed mode on a single machine
>>>>> and you can use it with localhost all the time.
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2013 at 10:00 PM, Cristian Carranza <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>>   Hi all in this list!
>>>>
+
Jay Vyas 2013-01-04, 17:47