Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - retrieving files from hdfs in cygwin


Copy link to this message
-
Re: retrieving files from hdfs in cygwin
Masoud 2011-10-29, 00:55
Hi,
i have exactly same problem, hadoop saving any data in C:,
not in cygvin area, after one day i could not solve the problem yet,

thanks

On 10/29/2011 01:38 AM, Keith Thompson wrote:
> The destination is just a folder on my C: drive.  C:/output/
> Since I could not get the file from the HDFS into that folder, I just re-ran
> the Hadoop job and had it put the output file directly onto the C drive
> instead of onto the HDFS.  So, yes it wrote to that location during the
> reduce stage.  But it just wouldn't -get from the HDFS and put the output in
> that location for some reason.
>
> Keith
>
> On Fri, Oct 28, 2011 at 12:26 PM, Mathijs Homminga<
> [EMAIL PROTECTED]>  wrote:
>
>> What is the<destination>  that you are using? Are you able to write to that
>> location?
>>
>> Mathijs Homminga
>>
>> On Oct 28, 2011, at 18:03, Keith Thompson<[EMAIL PROTECTED]>  wrote:
>>
>>> Hi,
>>>
>>> I have used Hadoop with Linux successfully and am now trying to use it on
>> a
>>> Windows machine running Cygwin. I ran a job and am now trying to use
>>>
>>> bin/hadoop fs -get<source>  <destination>
>>>
>>> to retrieve the files.  I can an error saying "get: Access is denied."
>>   Any
>>> insights into what may be causing this?  The output is there and I was
>> able
>>> to view it using
>>>
>>> bin/hadoop fs -text /path/to/output
>>>
>>> Regards,
>>>
>>> --
>>> *Keith Thompson*
>>> Graduate Research Associate, Xerox Corporation
>>> SUNY Research Foundation
>>> Dept. of Systems Science and Industrial Engineering
>>> Binghamton University
>>> work: 585-422-6587
>
>