| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
50 (0.066s).
|
|
|
Loading phrases to help you
refine your search...
|
|
How to use CombineFileInputFormat in Hadoop? - MapReduce - [mail # user]
|
|
...Gentles, I want to use the CombineFileInputFormat of Hadoop 0.20.0 / 0.20.2 such that it processes 1 file per record and also doesn't compromise on data - locality (which it normally t...
|
|
|
Author: Manoj Babu,
2012-07-12, 15:03
|
|
|
Re: Mapper basic question - MapReduce - [mail # user]
|
|
...Thanks All! On 11 Jul 2012 19:07, "Bejoy KS" wrote: ...
|
|
|
Author: Manoj Babu,
2012-07-11, 15:02
|
|
|
Re: Mapper basic question - MapReduce - [mail # user]
|
|
...Hi Tariq \Arun, The no of blocks(splits) = *total no of file size/hdfs block size * replicate value* The no of splits is again nothing but the blocks here. Other than incre...
|
|
|
Author: Manoj Babu,
2012-07-11, 12:47
|
|
|
Mapper basic question - MapReduce - [mail # user]
|
|
...Hi, The no of mappers is depends on the no of blocks. Is it possible to limit the no of mappers size without increasing the HDFS block size? Thanks in advance. Cheers! Mano...
|
|
|
Author: Manoj Babu,
2012-07-11, 12:29
|
|
|
Re: issue with map running time - MapReduce - [mail # user]
|
|
...Thanks Karthik. But how we can overcome that? do we need to user different file format? Also am using the below code to merge all files into single file. Is it a proper way to do it? ...
|
|
|
Author: Manoj Babu,
2012-07-10, 06:57
|
|
|
Re: How to change name node storage directory? - MapReduce - [mail # user]
|
|
...Hi Harsh, What permission do we need to provide for dfs.name.dir folder? and the remaining internal folder structures will it be created auto or do we need to create manual...
|
|
|
Author: Manoj Babu,
2012-07-10, 06:53
|
|
|
How to change name node storage directory? - MapReduce - [mail # user]
|
|
...Hi, It would be great if you could provide answer for the below doubts. 1,How to change name node storage directory?[i tried *hadoop.tmp.dir,**hadoop.name.dir but it leads to oth...
|
|
|
Author: Manoj Babu,
2012-07-10, 05:54
|
|
|
Re: Basic question on how reducer works - MapReduce - [mail # user]
|
|
...Hi Harsh, Thanks for clarifying. I was in thought earlier that Partitioner is picking the reducer. My cluster setup provides options for multiple reducers so i want to know when ...
|
|
|
Author: Manoj Babu,
2012-07-09, 18:07
|
|
|
Re: issue with map running time - MapReduce - [mail # user]
|
|
...Hi Bobby, I have faced a similar issue, In the job the block size is 64MB and the no of the maps created is 656 and the no of files uploaded to HDFS is 656 and its each file size is 11...
|
|
|
Author: Manoj Babu,
2012-07-09, 17:57
|
|
|
Re: Basic question on how reducer works - MapReduce - [mail # user]
|
|
...Hi, It would be more helpful, If you could more details for the below doubts. 1, How the partitioner knows which reducer needs to be called? 2, When we are using more than one re...
|
|
|
Author: Manoj Babu,
2012-07-09, 17:52
|
|
|
|
