Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 21 to 30 from 112 (0.159s).
Loading phrases to help you
refine your search...
Re: Cluster Summary, Heap Size - Hadoop - [mail # user]
...Oh, I presume this is the value of HADOOP_HEAPSIZE specified in the hadoop-env.sh and is the heap given to the deamon by Java. I guess this answers the question.  On Tue, Mar 2, 2010 at...
   Author: Saptarshi Guha, 2010-03-03, 17:45
Cluster Summary, Heap Size - Hadoop - [mail # user]
...Hello, I often notice "Cluster Summary (Heap Size is 281/889)" where the 281 is much when I start up Hadoop. How does this relate to Hadoop Mapreduce?  Thank you Saptarshi...
   Author: Saptarshi Guha, 2010-03-03, 03:46
Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
...Hello, I fixed this by running more than >=2 slaves. I was testing with 1 when this error occurred.  Regards Saptarshi  On Tue, Feb 23, 2010 at 2:57 PM, Todd Lipcon  wrote:...
   Author: Saptarshi Guha, 2010-02-26, 06:02
Fixed Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
...As a follow up, this is not peculiar to my programs but hadoop ones too: I started the cluster as (using Fedora AMI and c1.medium)  hadoop-ec2 launch-cluster --env REPO=testing --env HA...
   Author: Saptarshi Guha, 2010-02-19, 22:49
On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
...Hello, Not sure if i should post this here or on Cloudera's message board, but here goes. When I run EC2 using the latest CDH2 and Hadoop 0.20 (by settiing the env variables are hadoop-ec2),...
   Author: Saptarshi Guha, 2010-02-19, 22:13
A unique number for every task (map/reduce) - Hadoop - [mail # user]
...Hello, The name of a map task attempt is  attempt_201002092101_0063_m_N_X (N=1,.... # of map tasks)  and that of a reduce is  attempt_201002092101_0063_r_M_X where X is maybe ...
   Author: Saptarshi Guha, 2010-02-12, 17:07
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
...I think that port itself is blocked. I'll contact the sysadmins. Thanks  On Mon, Jan 11, 2010 at 7:46 PM, Saptarshi Guha  wrote: 10 min  there on...
   Author: Saptarshi Guha, 2010-01-12, 03:08
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
...So I gave a threshold, (0.20) and it started to run and I got several errors like this  10/01/11 19:43:56 WARN balancer.Balancer: Error moving block 795170313073485718 from spica:50010 ...
   Author: Saptarshi Guha, 2010-01-12, 00:46
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
...Hi, Yes, the config files are the same. I checked the namenode log for eac of the 5 pre-existing nodes I get something like  2010-01-10 12:32:33,921 INFO org.apache.hadoop.hdfs.StateCha...
   Author: Saptarshi Guha, 2010-01-10, 17:36
Balancing a cluster when a new node is added - Hadoop - [mail # user]
...Hello, I'm using Hadoop 0.20.1. I just added a new node to a 5 node cluster(for a total of 6), there is already about 500GB across 5 nodes. In order to distributed the data across the entire...
   Author: Saptarshi Guha, 2010-01-09, 17:44
Sort:
project
Hadoop (112)
HBase (19)
Avro (17)
Hive (8)
MapReduce (4)
Pig (3)
type
mail # user (112)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (3)
last 9 months (112)
author
Harsh J (1377)
Steve Loughran (931)
Owen O'Malley (816)
Todd Lipcon (756)
Arun C Murthy (575)
Eli Collins (513)
Allen Wittenauer (461)
Doug Cutting (344)
Konstantin Boudnik (335)
Mark Kerzner (334)
Edward Capriolo (328)
Ted Dunning (321)
Brian Bockelman (305)
Tom White (303)
jason hadoop (279)
Saptarshi Guha