Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> ConfigKeys wrappers for MapReduce source code base


Copy link to this message
-
ConfigKeys wrappers for MapReduce source code base
Hi guys:

A breif check wiht "find ./ -name *ConfigKeys*" doesn't seem to indicate
that there is a "MapRedConfigKeys" class... Should there be one to help get
rid of magic numbers and unify the namespace?  This seems to be the goal of
the DFSConfigKeys class in the HDFS source tree.

... Or are there differences in the way configuration values are handled in
mapred versus hdfs code bases ?

For example :

"job.getInt(JobContext.IO_SORT_FACTOR, 100)" in the ReduceTask class would
more typically be implemented (if in hdfs) using the DFSConfigKeys static
class which stores defaults and configuration parameter names.

Just curious wether there is any goal to take the Mapred configuration
values and unify their namespace in mapred/common in the same way that
seems to have been done in hdfs using the DFSConfigKeys class.

--
Jay Vyas
http://jayunit100.blogspot.com
+
Sandy Ryza 2013-04-22, 06:05
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB