Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re:


Copy link to this message
-
Re:
anil gupta 2012-07-29, 22:47
Seems like you are also stuck in the same problem as i am... I am going to
work on changing my conf tomorrow to fix this. How much memory your node
has?
Check the logs of Nodemanagers..At the bottom of the logs file you will see
that NM is stopping some components.(sorry i cant recall the exact name)

~Anil

On Sun, Jul 29, 2012 at 1:08 PM, abhiTowson cal
<[EMAIL PROTECTED]>wrote:

> Hi anil,
>
> Thanks for the reply.Same as your case my pi job is haulted and their
> is no progress.
>
> Regards
> Abhishek
>
> On Sun, Jul 29, 2012 at 3:31 PM, anil gupta <[EMAIL PROTECTED]> wrote:
> > Hi Abhishek,
> >
> > I didnt mean to ask you whether it returns result or not. I meant that
> you
> > should check that the classpath is correct. It should have the
> directories
> > where yarn is installed.
> >
> > ~Anil
> >
> > On Sun, Jul 29, 2012 at 12:23 PM, abhiTowson cal
> > <[EMAIL PROTECTED]>wrote:
> >
> >> hi anil,
> >>
> >> Hadoop class path is also working fine.
> >>
> >> Regards
> >> Abhishek
> >>
> >> Thanks for
> >>
> >> On Sun, Jul 29, 2012 at 3:20 PM, abhiTowson cal
> >> <[EMAIL PROTECTED]> wrote:
> >> > Hi Anil,
> >> >           Iam using chd4 with yarn.
> >> >
> >> > On Sun, Jul 29, 2012 at 3:17 PM, Anil Gupta <[EMAIL PROTECTED]>
> >> wrote:
> >> >> Are you using cdh4? In you cluster are you using yarn or mr1?
> >> >> Check the classpath of Hadoop by Hadoop classpath command.
> >> >>
> >> >> Best Regards,
> >> >> Anil
> >> >>
> >> >> On Jul 29, 2012, at 12:12 PM, abhiTowson cal <
> [EMAIL PROTECTED]>
> >> wrote:
> >> >>
> >> >>> HI Anil,
> >> >>>
> >> >>> I have already tried this,but issue could not be resolved.
> >> >>>
> >> >>> Regards
> >> >>> Abhishek
> >> >>>
> >> >>> On Sun, Jul 29, 2012 at 3:05 PM, anil gupta <[EMAIL PROTECTED]>
> >> wrote:
> >> >>>> Hi Abhishek,
> >> >>>>
> >> >>>> Once you make sure that whatever Harsh said in the previous email
> is
> >> >>>> present in the cluster and then also the job runs in Local Mode.
> Then
> >> try
> >> >>>> running the job with hadoop --config option.
> >> >>>> Refer to this discussion for more detail:
> >> >>>>
> >>
> https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/4tMGfvJFzrg
> >> >>>>
> >> >>>> HTH,
> >> >>>> Anil
> >> >>>>
> >> >>>> On Sun, Jul 29, 2012 at 11:43 AM, Harsh J <[EMAIL PROTECTED]>
> wrote:
> >> >>>>
> >> >>>>> For a job to get submitted to a cluster, you will need proper
> client
> >> >>>>> configurations. Have you configured your mapred-site.xml and
> >> >>>>> yarn-site.xml properly inside /etc/hadoop/conf/mapred-site.xml and
> >> >>>>> /etc/hadoop/conf/yarn-site.xml at the client node?
> >> >>>>>
> >> >>>>> On Mon, Jul 30, 2012 at 12:00 AM, abhiTowson cal
> >> >>>>> <[EMAIL PROTECTED]> wrote:
> >> >>>>>> Hi All,
> >> >>>>>>
> >> >>>>>> I am getting problem that job is running in localrunner rather
> than
> >> >>>>>> the cluster enviormnent.
> >> >>>>>> And when am running the job i would not be able to see the job
> id in
> >> >>>>>> the resource manager UI
> >> >>>>>>
> >> >>>>>> Can you please go through the issues and let me know ASAP.
> >> >>>>>>
> >> >>>>>> sudo -u hdfs hadoop jar
> >> >>>>>> /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar teragen
> >> >>>>>> 1000000 /benchmark/teragen/input
> >> >>>>>> 12/07/29 13:35:59 WARN conf.Configuration: session.id is
> >> deprecated.
> >> >>>>>> Instead, use dfs.metrics.session-id
> >> >>>>>> 12/07/29 13:35:59 INFO jvm.JvmMetrics: Initializing JVM Metrics
> with
> >> >>>>>> processName=JobTracker, sessionId> >> >>>>>> 12/07/29 13:35:59 INFO util.NativeCodeLoader: Loaded the
> >> native-hadoop
> >> >>>>> library
> >> >>>>>> 12/07/29 13:35:59 WARN mapred.JobClient: Use GenericOptionsParser
> >> for
> >> >>>>>> parsing the arguments. Applications should implement Tool for the
> >> >>>>>> same.
> >> >>>>>> Generating 1000000 using 1 maps with step of 1000000
> >> >>>>>> 12/07/29 13:35:59 INFO mapred.JobClient: Running job:
> job_local_0001

Thanks & Regards,
Anil Gupta