|
|
Hi
Anybody ran hadoop on cygwin for development purpose??? Did you have any problem in running tasktracker?
Thanks
+
Masoud 2011-11-01, 08:53
Why ?
The beauty of hadoop is its OS agnostic. What is your native operating system? I am sure you have a version of JDK and JRE running there. On Tue, Nov 1, 2011 at 4:53 AM, Masoud <[EMAIL PROTECTED]> wrote:
> Hi > > Anybody ran hadoop on cygwin for development purpose??? > Did you have any problem in running tasktracker? > > Thanks >
-- --- Get your facts first, then you can distort them as you please.--
Hi, I configured hadoop + cygwin on windows 7 as development station, when i run start-all.sh all daemons run excepting tasktracker ===>
2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker: Starting tasktracker with owner as cyg_server 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker: Good mapred local directories are: /tmp/hadoop-cyg_server/mapred/local 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker: Can *not start task tracker because java.io.IOException: Failed to set permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate to 0700* at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183) at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741) at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463) at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
what do you think????
thanks BR
On 11/01/2011 08:12 PM, Rita wrote: > Why ? > > The beauty of hadoop is its OS agnostic. What is your native operating > system? I am sure you have a version of JDK and JRE running there. > > > On Tue, Nov 1, 2011 at 4:53 AM, Masoud<[EMAIL PROTECTED]> wrote: > >> Hi >> >> Anybody ran hadoop on cygwin for development purpose??? >> Did you have any problem in running tasktracker? >> >> Thanks >> > >
+
Masoud 2011-11-02, 07:29
Hi,
Im running hadop 0.20.204 under cygwin 1.7 on Win7, java 1.6.22 i got this error:
2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker: *Can not start task tracker because java.io.IOException: Failed to set permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate to 0700 * I tried different ways, i even setted {hadoop.tmp.dir} to the cygwin home dir too, got same result, the problem is that JAVA using windows path and file permission to create HDFS, and i think under cygwin by simulating Linux behaviour Hadoop can not change the windows permission to Linux permission for mentioned folder in error message, Maybe its a bug and should fixed in source code.,
Any idea please.....
Thanks, Masoud.
On 11/01/2011 08:12 PM, Rita wrote: > Why ? > > The beauty of hadoop is its OS agnostic. What is your native operating > system? I am sure you have a version of JDK and JRE running there. > > > On Tue, Nov 1, 2011 at 4:53 AM, Masoud<[EMAIL PROTECTED]> wrote: > >> Hi >> >> Anybody ran hadoop on cygwin for development purpose??? >> Did you have any problem in running tasktracker? >> >> Thanks >> > >
+
Masoud 2011-11-03, 01:29
Joey Echeverria 2011-11-03, 11:19
What are the permissions on \tmp\hadoop-cyg_server\mapred\local\ttprivate?
Which user owns that directory?
Which user are you starting you TaskTracker as?
-Joey
On Wed, Nov 2, 2011 at 9:29 PM, Masoud <[EMAIL PROTECTED]> wrote: > Hi, > > Im running hadop 0.20.204 under cygwin 1.7 on Win7, java 1.6.22 > i got this error: > > 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker: > *Can not start task tracker because java.io.IOException: Failed to set > permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate > to 0700 * > I tried different ways, i even setted {hadoop.tmp.dir} to the cygwin home > dir too, got same result, > the problem is that JAVA using windows path and file permission to create > HDFS, and i think > under cygwin by simulating Linux behaviour Hadoop can not change the windows > permission to > Linux permission for mentioned folder in error message, > Maybe its a bug and should fixed in source code., > > Any idea please..... > > Thanks, > Masoud. > > On 11/01/2011 08:12 PM, Rita wrote: >> >> Why ? >> >> The beauty of hadoop is its OS agnostic. What is your native operating >> system? I am sure you have a version of JDK and JRE running there. >> >> >> On Tue, Nov 1, 2011 at 4:53 AM, Masoud<[EMAIL PROTECTED]> wrote: >> >>> Hi >>> >>> Anybody ran hadoop on cygwin for development purpose??? >>> Did you have any problem in running tasktracker? >>> >>> Thanks >>> >> >> > >
-- Joseph Echeverria Cloudera, Inc. 443.305.9434
+
Joey Echeverria 2011-11-03, 11:19
Dear Joey,
as you know when installing cygwin in new version of windows- for ssh to localhost- a new user created by cygwin (cyg_server). my main user is Administrator. I run namenode -fomat and dfs created in /tmp/Administrator-hadoop/ ~~~ .But tasktracker started by cyg_server and makes again /tmp/cyg_server-hadoop/~~~ I tried these :
* I installed cygwin again and by some way i changed the cyg_server to Administrator.now tasktracker is ran by Administrator to, but same error. * i changed hadoop.tmp.dir to the inside of cygwin dir, again same error.
*i think* the problem is related to Java, it makes HFDS based on windows path and permission. when i checked the hdfs permission under cygwin is --------- means nothing !!!! and then by running tasktracker it wana change the permission according to the Linux permission so it can't. i dont know what is the solution, ..... im playing with this issue around 4 days but no result.
BS. Masoud On 11/03/2011 08:19 PM, Joey Echeverria wrote: > What are the permissions on \tmp\hadoop-cyg_server\mapred\local\ttprivate? > > Which user owns that directory? > > Which user are you starting you TaskTracker as? > > -Joey > > On Wed, Nov 2, 2011 at 9:29 PM, Masoud<[EMAIL PROTECTED]> wrote: >> Hi, >> >> Im running hadop 0.20.204 under cygwin 1.7 on Win7, java 1.6.22 >> i got this error: >> >> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker: >> *Can not start task tracker because java.io.IOException: Failed to set >> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate >> to 0700 * >> I tried different ways, i even setted {hadoop.tmp.dir} to the cygwin home >> dir too, got same result, >> the problem is that JAVA using windows path and file permission to create >> HDFS, and i think >> under cygwin by simulating Linux behaviour Hadoop can not change the windows >> permission to >> Linux permission for mentioned folder in error message, >> Maybe its a bug and should fixed in source code., >> >> Any idea please..... >> >> Thanks, >> Masoud. >> >> On 11/01/2011 08:12 PM, Rita wrote: >>> Why ? >>> >>> The beauty of hadoop is its OS agnostic. What is your native operating >>> system? I am sure you have a version of JDK and JRE running there. >>> >>> >>> On Tue, Nov 1, 2011 at 4:53 AM, Masoud<[EMAIL PROTECTED]> wrote: >>> >>>> Hi >>>> >>>> Anybody ran hadoop on cygwin for development purpose??? >>>> Did you have any problem in running tasktracker? >>>> >>>> Thanks >>>> >>> >> > >
+
Masoud 2011-11-04, 01:42
|
|