Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> hive mapred problem


Copy link to this message
-
Re: hive mapred problem
I am not sure what you mean by distibuted hive.

but a multinode hadoop cluster setup you can setup using following link
http://ankitasblogger.blogspot.in/2011/01/hadoop-cluster-setup.html

if you run into hic-ups feel free to reach me out on my email (dont
want hive userlist to be bugged for hadoop installations)
On Tue, Oct 9, 2012 at 3:54 PM, Ajit Kumar Shreevastava
<[EMAIL PROTECTED]> wrote:
> Hi Nitin
>
> Sorry Nitin, Actually I mean Fully distributed mode( hadoop on multimode).
> I want configuration file for both hadoop and hive.
>
>
>
> -----Original Message-----
> From: Nitin Pawar [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, October 09, 2012 2:46 PM
> To: [EMAIL PROTECTED]
> Subject: Re: hive mapred problem
>
> I did not get the distributed mode for hadoop and hive question. can
> you explain what exactly what you want to achieve ?
>
> Thanks,
> Nitin
>
> On Tue, Oct 9, 2012 at 2:42 PM, Ajit Kumar Shreevastava
> <[EMAIL PROTECTED]> wrote:
>> Hi Nitin,
>>
>>
>>
>> Thanks for your reply...
>>
>>
>>
>> Now my query is running but output is like :-->
>>
>>
>>
>> hive> select count(1) from pokes;
>>
>> Total MapReduce jobs = 1
>>
>> Launching Job 1 out of 1
>>
>> Number of reduce tasks determined at compile time: 1
>>
>> In order to change the average load for a reducer (in bytes):
>>
>>   set hive.exec.reducers.bytes.per.reducer=<number>
>>
>> In order to limit the maximum number of reducers:
>>
>>   set hive.exec.reducers.max=<number>
>>
>> In order to set a constant number of reducers:
>>
>>   set mapred.reduce.tasks=<number>
>>
>> Starting Job = job_201210091435_0001, Tracking URL >> http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210091435_0001
>>
>> Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job  -kill
>> job_201210091435_0001
>>
>> Hadoop job information for Stage-1: number of mappers: 1; number of
>> reducers: 2
>>
>> 2012-10-09 14:37:14,587 Stage-1 map = 0%,  reduce = 0%
>>
>> 2012-10-09 14:37:20,609 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:21,613 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:22,620 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:23,625 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:24,630 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:25,634 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:26,638 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:27,642 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:28,650 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:29,654 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:30,658 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:31,662 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU
>> 0.47 sec
>>
>> 2012-10-09 14:37:32,667 Stage-1 map = 100%,  reduce = 50%, Cumulative CPU
>> 1.66 sec
>>
>> 2012-10-09 14:37:33,672 Stage-1 map = 100%,  reduce = 50%, Cumulative CPU
>> 1.66 sec
>>
>> 2012-10-09 14:37:34,678 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:35,682 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:36,686 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:37,690 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:38,694 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:39,698 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> 2012-10-09 14:37:40,702 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU
>> 3.0 sec
>>
>> MapReduce Total cumulative CPU time: 3 seconds 0 msec
>>
>> Ended Job = job_201210091435_0001
>>
>> MapReduce Jobs Launched:

Nitin Pawar