Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 20 (0.062s).
Loading phrases to help you
refine your search...
[MAPREDUCE-2841] Task level native optimization - MapReduce - [issue]
...I'm recently working on native optimization for MapTask based on JNI. The basic idea is that, add a NativeMapOutputCollector to handle k/v pairs emitted by mapper, therefore sort, spill, IFi...
http://issues.apache.org/jira/browse/MAPREDUCE-2841    Author: Binglin Chang, 2014-04-05, 23:32
Re: Helper files in python - MapReduce - [mail # user]
...If you mean to make those files available in map/reduce tasks: How about put them in one directory, say "app", and specify -file app -mapper app/xxx -reducer app/xx...  , hadoop will pa...
   Author: Binglin Chang, 2013-08-29, 03:56
Re: Is there any possible way to use hostname variable in mapred-site.xml file - MapReduce - [mail # user]
...How about add -Dhost.name=`hostname` in HADOOP_OPTS and get this variable in config file ${host.name} ? I have not tried this, you can try this.   On Thu, Aug 15, 2013 at 5:26 PM, Kun L...
   Author: Binglin Chang, 2013-08-15, 09:51
Re: How to import custom Python module in MapReduce job? - MapReduce - [mail # user]
...Maybe you doesn't specify symlink name in you cmd line, so the symlink name will be just lib.jar, so I am not sure how you import lib module in your main.py file. Please try this: put main.p...
   Author: Binglin Chang, 2013-08-12, 10:12
Re: metics v1 in hadoop-2.0.5 - MapReduce - [mail # user]
...metrics v1 is deprecated, both in 1.2 and 2.x.  the existence of hadoop-metrics.properties is confusing, I think it should be removed.   On Mon, Aug 5, 2013 at 6:26 PM, lei liu &nb...
   Author: Binglin Chang, 2013-08-05, 10:50
[MAPREDUCE-4944] Backport YARN-40 to support listClusterNodes and printNodeStatus in command line tool - MapReduce - [issue]
...support listClusterNodes and printNodeStatus in command line tool is useful for admin to create certain automation tools, this can also used by MAPREDUCE-4900 to get TaskTracker name so can ...
http://issues.apache.org/jira/browse/MAPREDUCE-4944    Author: Binglin Chang, 2013-05-14, 06:14
[MAPREDUCE-3247] Add hash aggregation style data flow and/or new API - MapReduce - [issue]
...In many join/aggregation like queries run on top of mapreduce, sort is not need, in fact a hash table based join/aggregation is more efficient, this is described in "Tenzing A SQL Implementa...
http://issues.apache.org/jira/browse/MAPREDUCE-3247    Author: Binglin Chang, 2012-12-11, 01:59
Re: problem with hadoop-snappy - MapReduce - [mail # user]
...Have you installed snappy library (which should have libsnappy.so in /usr/lib or /usr/local/lib) first?    On Wed, Nov 7, 2012 at 5:30 AM,  wrote:  ...
   Author: Binglin Chang, 2012-11-07, 01:34
Re: Tools for extracting data from hadoop logs - MapReduce - [mail # user]
...Hi,  I think you want to analyze hadoop job logs in jobtracker history folder? These logs are in a centralized folder and don't need tools like flume or scribe to gather them. I used to...
   Author: Binglin Chang, 2012-10-30, 03:24
[MAPREDUCE-3612] Task.TaskReporter.done method blocked for some time when task is finishing - MapReduce - [issue]
...We recently have done some tests to evaluate performances of different Hadoop versions(1.0, 0.23, Baidu internal version), and found some weird results. One of them is in 1.0 Task.TaskReport...
http://issues.apache.org/jira/browse/MAPREDUCE-3612    Author: Binglin Chang, 2012-07-07, 00:31
HDFS (27)
Hadoop (20)
MapReduce (20)
Avro (3)
HBase (1)
Hive (1)
issue (11)
mail # user (9)
last 7 days (0)
last 30 days (1)
last 90 days (1)
last 6 months (1)
last 9 months (20)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (307)
Todd Lipcon (197)
Amar Kamat (181)
Thomas Graves (164)
Amareshwari Sriramadasu (153)
Jason Lowe (150)
Owen O'Malley (126)
Sandy Ryza (123)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Ramya Sunil (103)
Devaraj K (102)
Binglin Chang