I am running a job on a cluster launching from a windows box and "
fs.default.name" to point the job to the cluster.
Everything works until the last step where I say

FileSystem fileSystem = FileSystem.get(config); // this is hdfs
fileSystem.copyToLocalFile(src, dst); // local system

at this point RawLocalFileSystem tries to exec chmod which is not on
windows.

This looks like a bug - it seems that there should be a fallback system or
better yet a call to the
Java standard File.canWrite command before attempting to alter permissions

--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

Hi,
  you'll probably need to be running this under cygwin since windows native
is not supported.

2011/11/21 Steve Lewis <[EMAIL PROTECTED]>

> I am running a job on a cluster launching from a windows box and "
> fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on
> windows.
>
> This looks like a bug - it seems that there should be a fallback system or
> better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
>

Steve,

We do welcome improvement patches for better Windows support. Would you mind filing a JIRA and a patch for this under HADOOP?

On 22-Nov-2011, at 5:17 AM, Steve Lewis wrote:

> I am running a job on a cluster launching from a windows box and "fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on windows.
>
> This looks like a bug - it seems that there should be a fallback system or better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>

This is the only problem with running Hadoop on Windows without Cygwin.

Also, you might be able to install the 'core' package of 'gnuwin32' and add
the chmod.exe there to your path.

http://sourceforge.net/projects/gnuwin32/files/

On Mon, Nov 21, 2011 at 6:14 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Steve,
>
> We do welcome improvement patches for better Windows support. Would you
> mind filing a JIRA and a patch for this under HADOOP?
>
> On 22-Nov-2011, at 5:17 AM, Steve Lewis wrote:
>
> I am running a job on a cluster launching from a windows box and "
> fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on
> windows.
>
> This looks like a bug - it seems that there should be a fallback system or
> better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
>
>
--
Lance Norskog
[EMAIL PROTECTED]