Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Datanode: "Cannot start secure cluster without privileged resources"


Copy link to this message
-
Re: Datanode: "Cannot start secure cluster without privileged resources"
Harsh J 2012-11-26, 14:30
Could you also check what 16152 is? The jsvc is a launcher process,
not the JVM itself.

As I mentioned, JPS is pretty reliable, just wont' show the name of
the JVM launched by a custom wrapper - and will show just PID.

On Mon, Nov 26, 2012 at 7:35 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> Hi,
>
> Thanks for your reply.
>
> However, I think 16152 should not be the DN, since
> 1) my second try of "/usr/local/hadoop/bin/hadoop-daemon.sh start datanode" says 16117 (i.e. I ran start datanode twice), and
> 2) ps axu | grep 16117, I got
> root     16117  0.0  0.0  17004   904 pts/2    S    21:34   0:00 jsvc.exec -Dproc_datanode -outfile /usr/local/hadoop-1.0.4/libexec/ ...
>
> These are the two reasons that I think JPS is no longer a tool to check secure DN.
>
> Thanks again!
>
>
> On 26 Nov 2012, at 9:47 PM, Harsh J wrote:
>
>> The 16152 should be the DN JVM I think. This is a jps limitation, as
>> seen at http://docs.oracle.com/javase/1.5.0/docs/tooldocs/share/jps.html
>> and jsvc (which secure mode DN uses) is such a custom launcher.
>>
>> "The jps command uses the java launcher to find the class name and
>> arguments passed to the main method. If the target JVM is started with
>> a custom launcher, the class name (or JAR file name) and the arguments
>> to the main method will not be available. In this case, the jps
>> command will output the string Unknownfor the class name or JAR file
>> name and for the arguments to the main method."
>>
>> On Mon, Nov 26, 2012 at 7:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> A question:
>>> I started Secure DN then ran JPS as root, I could not find any running DN:
>>> 16152
>>> 16195 Jps
>>>
>>> However, when I tried to start the secure DN again, I got:
>>> Warning: $HADOOP_HOME is deprecated.
>>> datanode running as process 16117. Stop it first.
>>>
>>> Does it mean JPS is no longer a tool to check DN in secure mode?
>>>
>>> Thanks
>>>
>>>
>>> On 26 Nov 2012, at 9:03 PM, [EMAIL PROTECTED] wrote:
>>>
>>>> Hi Harsh,
>>>>
>>>> Thank you very much for your reply, got it!
>>>>
>>>> Thanks
>>>> ac
>>>>
>>>> On 26 Nov 2012, at 8:32 PM, Harsh J wrote:
>>>>
>>>>> Secure DN needs to be started as root (it runs as proper user, but
>>>>> needs to be started as root to grab reserved ports), and needs a
>>>>> proper jsvc binary (for your arch/OS) available. Are you using
>>>>> tarballs or packages (and if packages, are they from Bigtop)?
>>>>>
>>>>> On Mon, Nov 26, 2012 at 5:21 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
>>>>>> Hi,
>>>>>>
>>>>>> I am setting up HDFS security with Kerberos:
>>>>>> When I manually started the first datanode, I got the following messages (the namenode is started):
>>>>>>
>>>>>> 1) INFO org.apache.hadoop.security.UserGroupInformation: Login successful for user ....
>>>>>> 2) ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.lang.RuntimeException: Cannot start secure cluster without privileged resources.
>>>>>>
>>>>>> OS: Ubuntu 12.04
>>>>>> Hadoop: 1.0.4
>>>>>>
>>>>>> It seems that it could login successfully but something is missing
>>>>>> Please help!
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Harsh J
>>>>
>>>
>>
>>
>>
>> --
>> Harsh J
>

--
Harsh J