Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 10 (0.073s).
Loading phrases to help you
refine your search...
error in escaping "/" and "+" in hadoop s3://key:secret@bucket/ - Hadoop - [mail # user]
...previously this does work, by escaping "/" with "%2F" (not sure about the "+" case)   now hadoop gives me error saying that signature is wrong.  I went back and generated a new key...
   Author: Yang, 2013-01-18, 23:35
out of memory for Reducer possible? - Hadoop - [mail # user]
...if I do a  X = GROUP ALL my_relation;  in pig.  and let's say X is very big, and contains 1billion records, in the reducer,would it be possible for the reducer to get OOM or s...
   Author: Yang, 2012-08-24, 01:43
[expand - 3 more] - Re: can't disable speculative execution? - Hadoop - [mail # user]
...Thanks Harsh  I did set mapred.map.tasks = 1  but still I can consistently see 3 mappers being invoked  and the order is always like this:  ****_00002_0 ***_00000_0 ***_0...
   Author: Yang, 2012-07-12, 06:39
force minimum number of nodes to run a job? - Hadoop - [mail # user]
...let's say my job can run on 4 mapper slots, but if there is only 1 slot available, I don't want them to run one by one, and have to wait till the time that at least 4 slots are available. &n...
   Author: Yang, 2012-07-03, 00:18
bug in streaming? - Hadoop - [mail # user]
...if I set input to a file that contains just 1 line (which does not even contain "\n")  and the mapper is  -mapper " bash -c './a.sh' "  and a.sh is  echo -n "|" cat echo ...
   Author: Yang, 2012-07-02, 21:16
S3-->HDFS -->MR or S3-->MR ? - Hadoop - [mail # user]
...our raw data is in S3, and we need to process them, and dump the output to S3.  so there is no need to store the raw data or output on HDFS.  but since MR works on hdfs,  we n...
   Author: Yang, 2012-06-20, 04:56
ulimit -v changed for child job? - Hadoop - [mail # user]
...the Child of our jobs are launched using user hdfs  we got OOM in some jobs when they try to mmap() a big file.  I manually checked the ulimit -v of hdfs on the slave nodes, they a...
   Author: Yang, 2012-06-13, 22:41
[expand - 2 more] - Re: reducer out of memory? - Hadoop - [mail # user]
...thanks, let me run more of this with the settings provided later in this thread and provide the details  On Wed, May 9, 2012 at 10:12 PM, Harsh J  wrote:  output,...
   Author: Yang, 2012-05-10, 18:50
AvatarNode by FB? - Hadoop - [mail # user]
...as described in http://www.google.com/url?sa=t&source=web&cd=1&ved=0CBgQFjAA&url=http%3A%2F%2Fhadoopblog.blogspot.com%2F2010%2F02%2Fhadoop-namenode-high-availability.html&ei=D4MkTsCrI8TRiALN...
   Author: Yang, 2011-07-18, 19:05
question on write failure and commit in HDFS - Hadoop - [mail # user]
...I wonder what happens if a HDFS client writes to 3 replicas, but only one of them succeeds, but the other 2 fail, then the client considers the operation a failure, but what happens to the s...
   Author: Yang, 2011-07-02, 05:32
Sort:
project
Pig (42)
Avro (26)
Hadoop (10)
Hive (10)
Zookeeper (10)
HBase (4)
Kafka (4)
MapReduce (4)
type
mail # user (10)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (10)
author
Harsh J (558)
Owen O'Malley (394)
Steve Loughran (387)
Todd Lipcon (239)
Eli Collins (182)
Alejandro Abdelnur (178)
Arun C Murthy (163)
Allen Wittenauer (148)
Chris Nauroth (146)
Ted Yu (121)
Tom White (121)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Doug Cutting (96)
Aaron Kimball (93)
Colin Patrick McCabe (92)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (70)
Suresh Srinivas (64)
Yang