Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Permission problem in Junit test - Hadoop 2.2.0


Copy link to this message
-
Re: Permission problem in Junit test - Hadoop 2.2.0
Note: I have built hadoop not in my home directory but rather in a
different volume.

--
Best Regards,
Karim Ahmed Awara
On Wed, Dec 18, 2013 at 10:41 AM, Karim Awara <[EMAIL PROTECTED]>wrote:

>
> Still the same problem. IF you notice, The unit test actually created the
> directories upto  $HOME_HDFS/build/test/data/dfs  without problems at all.
> I think that because MiniDFSCluster is emulating a cluster of one namenode
> and two datanodes, it tries to create dir for th datanodes and this is
> where it hit the permissions problem. May be something related to
> localhost  settings?
>
> --
> Best Regards,
> Karim Ahmed Awara
>
>
> On Wed, Dec 18, 2013 at 2:47 AM, Andre Kelpe <[EMAIL PROTECTED]>wrote:
>
>> You have to start eclipse from an environment that has the correct umask
>> set, otherwise it will not inherit the settings.
>>
>> Open a terminal, do umask 022 && eclipse and re-try to run the tests.
>>
>> - André
>>
>>
>> On Wed, Dec 18, 2013 at 12:35 AM, Karim Awara <[EMAIL PROTECTED]>wrote:
>>
>>>
>>> Yes. Nothing yet. I should mention I compiled hadoop 2.2 from the src
>>> using maven on a single machine (mac os x). It seems whatever I do in the
>>> permissions, the error persists.
>>>
>>> --
>>> Best Regards,
>>> Karim Ahmed Awara
>>>
>>>
>>> On Wed, Dec 18, 2013 at 2:24 AM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>>
>>>> Have you set umask to 022 ?
>>>>
>>>> See https://issues.apache.org/jira/browse/HDFS-2556
>>>>
>>>> Cheers
>>>>
>>>>
>>>> On Tue, Dec 17, 2013 at 3:12 PM, Karim Awara <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am running Junit test on hadoop 2.2.0 on eclipse on mac os x.
>>>>> Whenever I run the test, I am faced with the following error
>>>>>
>>>>> It seems there is a problem with the permission test data dir.
>>>>> Please advise.
>>>>>
>>>>>
>>>>> 2013-12-18 02:09:19,326 ERROR hdfs.MiniDFSCluster
>>>>> (MiniDFSCluster.java:initMiniDFSCluster(647)) - IOE creating namenodes.
>>>>> Permissions dump:
>>>>> path 'build/test/data/dfs/data':
>>>>>
>>>>> absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data/dfs/data
>>>>>     permissions: ----
>>>>> path 'build/test/data/dfs':
>>>>>
>>>>> absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data/dfs
>>>>>     permissions: drwx
>>>>> path 'build/test/data':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test/data
>>>>>     permissions: drwx
>>>>> path 'build/test':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build/test
>>>>>     permissions: drwx
>>>>> path 'build':
>>>>>     absolute:/Volumes/Me/kepler_workspace/hadoop-hdfs/build
>>>>>     permissions: drwx
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best Regards,
>>>>> Karim Ahmed Awara
>>>>>
>>>>> ------------------------------
>>>>> This message and its contents, including attachments are intended
>>>>> solely for the original recipient. If you are not the intended recipient or
>>>>> have received this message in error, please notify me immediately and
>>>>> delete this message from your computer system. Any unauthorized use or
>>>>> distribution is prohibited. Please consider the environment before printing
>>>>> this email.
>>>>
>>>>
>>>>
>>>
>>> ------------------------------
>>> This message and its contents, including attachments are intended solely
>>> for the original recipient. If you are not the intended recipient or have
>>> received this message in error, please notify me immediately and delete
>>> this message from your computer system. Any unauthorized use or
>>> distribution is prohibited. Please consider the environment before printing
>>> this email.
>>>
>>
>>
>>
>> --
>> André Kelpe
>> [EMAIL PROTECTED]
>> http://concurrentinc.com
>>
>
>

--

------------------------------
This message and its contents, including attachments are intended solely
for the original recipient. If you are not the intended recipient or have
received this message in error, please notify me immediately and delete
this message from your computer system. Any unauthorized use or
distribution is prohibited. Please consider the environment before printing
this email.