|
|
-
RE: jps problemAjit Kumar Shreevastava 2012-10-10, 08:43
Hi Bejoy,
Thanx for ur reply. My jps command is also failed in datanode. When I run command on master node:-->(java version is 1.6.32) [hadoop@NHCLT-PC44-2 bin]$ jps 31791 NameNode 31937 DataNode 1292 Jps 32176 JobTracker 32309 TaskTracker 32086 SecondaryNameNode [hadoop@NHCLT-PC44-2 bin]$ When I run on datanode:--> (java version is 1.6.35) [hadoop@NHCLT-PC44-4 ~]$ jps [hadoop@NHCLT-PC44-4 ~]$ Can you please let me know where I lag? Regards, Ajit From: Bejoy KS [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 09, 2012 5:58 PM To: [EMAIL PROTECTED] Subject: Re: hive mapred problem Hi Ajit Is Oracle jdk used in your data nodes? If it is open jdk then I guess jps won't work. Also have you configured java correctly on DNs for the user that issues jps command? The hive 'GettingStarted' on hive wiki is a good start off. It lets you know which all properties to override in your hive-site.xml. Regards Bejoy KS Sent from handheld, please excuse typos. ________________________________ From: Ajit Kumar Shreevastava <[EMAIL PROTECTED]> Date: Tue, 9 Oct 2012 16:59:20 +0530 To: [EMAIL PROTECTED]<[EMAIL PROTECTED]> ReplyTo: [EMAIL PROTECTED] Subject: RE: hive mapred problem Hi Nitin, Thanks for your reply. I want configuration file of hive with respect to distributed hadoop. Again My jps command is also failed in datanode. When I run command on master node:--> [hadoop@NHCLT-PC44-2 hadoop]$ jps 5694 NameNode 5992 SecondaryNameNode 5843 DataNode 6224 TaskTracker 6085 JobTracker 6701 Jps 4785 RunJar But when I run the same command on slave node:--> [hadoop@NHCLT-PC44-4 hadoop]$ jps -bash: jps: command not found Can you please help me in this regard. -----Original Message----- From: Nitin Pawar [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 09, 2012 4:03 PM To: [EMAIL PROTECTED] Subject: Re: hive mapred problem I am not sure what you mean by distibuted hive. but a multinode hadoop cluster setup you can setup using following link http://ankitasblogger.blogspot.in/2011/01/hadoop-cluster-setup.html if you run into hic-ups feel free to reach me out on my email (dont want hive userlist to be bugged for hadoop installations) On Tue, Oct 9, 2012 at 3:54 PM, Ajit Kumar Shreevastava <[EMAIL PROTECTED]> wrote: > Hi Nitin > > Sorry Nitin, Actually I mean Fully distributed mode( hadoop on multimode). > I want configuration file for both hadoop and hive. > > > > -----Original Message----- > From: Nitin Pawar [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, October 09, 2012 2:46 PM > To: [EMAIL PROTECTED] > Subject: Re: hive mapred problem > > I did not get the distributed mode for hadoop and hive question. can > you explain what exactly what you want to achieve ? > > Thanks, > Nitin > > On Tue, Oct 9, 2012 at 2:42 PM, Ajit Kumar Shreevastava > <[EMAIL PROTECTED]> wrote: >> Hi Nitin, >> >> >> >> Thanks for your reply... >> >> >> >> Now my query is running but output is like :--> >> >> >> >> hive> select count(1) from pokes; >> >> Total MapReduce jobs = 1 >> >> Launching Job 1 out of 1 >> >> Number of reduce tasks determined at compile time: 1 >> >> In order to change the average load for a reducer (in bytes): >> >> set hive.exec.reducers.bytes.per.reducer=<number> >> >> In order to limit the maximum number of reducers: >> >> set hive.exec.reducers.max=<number> >> >> In order to set a constant number of reducers: >> >> set mapred.reduce.tasks=<number> >> >> Starting Job = job_201210091435_0001, Tracking URL >> http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210091435_0001 >> >> Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job -kill >> job_201210091435_0001 >> >> Hadoop job information for Stage-1: number of mappers: 1; number of >> reducers: 2 >> >> 2012-10-09 14:37:14,587 Stage-1 map = 0%, reduce = 0% >> >> 2012-10-09 14:37:20,609 Stage-1 map = 100%, reduce = 0%, Cumulative CPU Nitin Pawar |