Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hadoop + cygwin


Copy link to this message
-
Re: Hadoop + cygwin
Dear Joey,

as you know when installing cygwin in new version of windows- for ssh to
localhost- a new user created by cygwin (cyg_server). my main user is
Administrator.
I run namenode -fomat and dfs created in /tmp/Administrator-hadoop/ ~~~
.But tasktracker started by cyg_server and makes again
/tmp/cyg_server-hadoop/~~~
I tried these :

  * I installed cygwin again and by some way i changed the cyg_server to
    Administrator.now tasktracker is ran by Administrator to, but same
    error.
  * i changed hadoop.tmp.dir to the inside of cygwin dir, again same error.

*i think* the problem is related to Java, it makes HFDS based on windows
path and permission. when i checked the hdfs permission under cygwin is
--------- means nothing !!!!
and then by running tasktracker it wana change the permission according
to the Linux permission so it can't.
i dont know what is the solution, ..... im playing with this issue
around 4 days but no result.

BS.
Masoud
On 11/03/2011 08:19 PM, Joey Echeverria wrote:
> What are the permissions on \tmp\hadoop-cyg_server\mapred\local\ttprivate?
>
> Which user owns that directory?
>
> Which user are you starting you TaskTracker as?
>
> -Joey
>
> On Wed, Nov 2, 2011 at 9:29 PM, Masoud<[EMAIL PROTECTED]>  wrote:
>> Hi,
>>
>> Im running hadop 0.20.204 under cygwin 1.7 on Win7, java 1.6.22
>> i got this error:
>>
>> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
>> *Can not start task tracker because java.io.IOException: Failed to set
>> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
>> to 0700 *
>>   I tried different ways, i even setted {hadoop.tmp.dir} to the cygwin home
>> dir too, got same result,
>> the problem is that JAVA using windows path and file permission to create
>> HDFS, and i think
>> under cygwin by simulating Linux behaviour Hadoop can not change the windows
>> permission to
>> Linux permission for mentioned folder in error message,
>> Maybe its a bug and should fixed in source code.,
>>
>> Any idea please.....
>>
>> Thanks,
>> Masoud.
>>
>> On 11/01/2011 08:12 PM, Rita wrote:
>>> Why ?
>>>
>>> The beauty of hadoop is its OS agnostic. What is your native operating
>>> system? I am sure you have a version of JDK and JRE running there.
>>>
>>>
>>> On Tue, Nov 1, 2011 at 4:53 AM, Masoud<[EMAIL PROTECTED]>    wrote:
>>>
>>>> Hi
>>>>
>>>> Anybody ran hadoop on cygwin for development purpose???
>>>> Did you have any problem in running tasktracker?
>>>>
>>>> Thanks
>>>>
>>>
>>
>
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB