Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 50 (0.184s).
Loading phrases to help you
refine your search...
Re: Block size - MapReduce - [mail # user]
...Yes it can. It is a configurable property. The exact name might differ depending on the version though.   Read the details here: https://hadoop.apache.org/docs/current2/hadoop-project-d...
   Author: Shahab Yunus, 2014-01-03, 16:45
Re: Log file size limiting and log file rotation configurations in hadoop - MapReduce - [mail # user]
...I am assuming that you are talking about user logs? See the following links for some pointers:  http://grepalex.com/2012/11/12/hadoop-logging/ http://blog.cloudera.com/blog/2010/11/hado...
   Author: Shahab Yunus, 2013-10-03, 12:17
[expand - 1 more] - Re: set the number of reduce tasks in the wordcount by command line - MapReduce - [mail # user]
...See an example here: http://www.crobak.org/2011/12/getting-started-with-apache-hadoop-0-23-0/  For the 'pi' program. Basically you will specify it through the command line interface. &n...
   Author: Shahab Yunus, 2013-09-25, 22:43
Re: Mapreduce jobtracker recover property - MapReduce - [mail # user]
...*mapred.jobtracker.restart.recover *is the old API, while the other one is for new. It is used to specify whether the job should try to resume at recovering time and when restarting. If you ...
   Author: Shahab Yunus, 2013-09-24, 03:02
[expand - 1 more] - Re: MAP_INPUT_RECORDS counter in the reducer - MapReduce - [mail # user]
...Yes, you are correct that copying phase starts while the maps are running and the reduce function is not called until everything is done but aren't the Reduce tasks are also already 'initial...
   Author: Shahab Yunus, 2013-09-18, 13:46
Re: Yarn log directory perms - MapReduce - [mail # user]
...Just a thought, I don't know how much it makes sense, why not run that program as the user who is allowed to read that directory and you can then allow that user to write to whichever direct...
   Author: Shahab Yunus, 2013-09-14, 23:38
Re: Cloudera Vs Hortonworks Vs MapR - MapReduce - [mail # user]
...I think, in my opinion, it is a wrong idea because:  1- Many of the participants here are employees for these very companies that are under discussion. This puts these respective employ...
   Author: Shahab Yunus, 2013-09-13, 17:48
Re: chaining (the output of) jobs/ reducers - MapReduce - [mail # user]
..."The temporary file solution will work in a single node configuration, but I'm not sure about an MPP config.  Let's say Job A runs on nodes 0 and 1 and job B runs on nodes 2 and 3 or bo...
   Author: Shahab Yunus, 2013-09-12, 17:33
Re: can the parameters dfs.block.size and dfs.replication be different from one file to the other - MapReduce - [mail # user]
..."can be set at the time I load the file to the HDFS (that is, it is the client side setting)? " I don't think you can do this while reading. These are done at the time of writing.  You ...
   Author: Shahab Yunus, 2013-09-10, 18:38
Re: hadoop cares about /etc/hosts ? - MapReduce - [mail # user]
...I think he means the 'masters' file found only at the master node(s) at conf/masters.  Details here: http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-clus...
   Author: Shahab Yunus, 2013-09-09, 14:26
Sort:
project
HBase (47)
MapReduce (43)
Hadoop (37)
Pig (35)
HDFS (17)
Spark (1)
type
mail # user (50)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (50)
author
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (215)
Amar Kamat (181)
Thomas Graves (165)
Jason Lowe (159)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Devaraj K (103)
Ramya Sunil (103)
Alejandro Abdelnur (102)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (78)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (70)
Mahadev konar (67)
Ravi Prakash (66)
Shahab Yunus