| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
112 (0.158s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: Cluster Summary, Heap Size - Hadoop - [mail # user]
|
|
...Oh, I presume this is the value of HADOOP_HEAPSIZE specified in the hadoop-env.sh and is the heap given to the deamon by Java. I guess this answers the question. On Tue, Mar 2, 2010 at...
|
|
|
Author: Saptarshi Guha,
2010-03-03, 17:45
|
|
|
Cluster Summary, Heap Size - Hadoop - [mail # user]
|
|
...Hello, I often notice "Cluster Summary (Heap Size is 281/889)" where the 281 is much when I start up Hadoop. How does this relate to Hadoop Mapreduce? Thank you Saptarshi...
|
|
|
Author: Saptarshi Guha,
2010-03-03, 03:46
|
|
|
Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
|
|
...Hello, I fixed this by running more than >=2 slaves. I was testing with 1 when this error occurred. Regards Saptarshi On Tue, Feb 23, 2010 at 2:57 PM, Todd Lipcon wrote:...
|
|
|
Author: Saptarshi Guha,
2010-02-26, 06:02
|
|
|
Fixed Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
|
|
...As a follow up, this is not peculiar to my programs but hadoop ones too: I started the cluster as (using Fedora AMI and c1.medium) hadoop-ec2 launch-cluster --env REPO=testing --env HA...
|
|
|
Author: Saptarshi Guha,
2010-02-19, 22:49
|
|
|
On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir - Hadoop - [mail # user]
|
|
...Hello, Not sure if i should post this here or on Cloudera's message board, but here goes. When I run EC2 using the latest CDH2 and Hadoop 0.20 (by settiing the env variables are hadoop-ec2),...
|
|
|
Author: Saptarshi Guha,
2010-02-19, 22:13
|
|
|
A unique number for every task (map/reduce) - Hadoop - [mail # user]
|
|
...Hello, The name of a map task attempt is attempt_201002092101_0063_m_N_X (N=1,.... # of map tasks) and that of a reduce is attempt_201002092101_0063_r_M_X where X is maybe ...
|
|
|
Author: Saptarshi Guha,
2010-02-12, 17:07
|
|
|
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
|
|
...I think that port itself is blocked. I'll contact the sysadmins. Thanks On Mon, Jan 11, 2010 at 7:46 PM, Saptarshi Guha wrote: 10 min there on...
|
|
|
Author: Saptarshi Guha,
2010-01-12, 03:08
|
|
|
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
|
|
...So I gave a threshold, (0.20) and it started to run and I got several errors like this 10/01/11 19:43:56 WARN balancer.Balancer: Error moving block 795170313073485718 from spica:50010 ...
|
|
|
Author: Saptarshi Guha,
2010-01-12, 00:46
|
|
|
Re: Balancing a cluster when a new node is added - Hadoop - [mail # user]
|
|
...Hi, Yes, the config files are the same. I checked the namenode log for eac of the 5 pre-existing nodes I get something like 2010-01-10 12:32:33,921 INFO org.apache.hadoop.hdfs.StateCha...
|
|
|
Author: Saptarshi Guha,
2010-01-10, 17:36
|
|
|
Balancing a cluster when a new node is added - Hadoop - [mail # user]
|
|
...Hello, I'm using Hadoop 0.20.1. I just added a new node to a 5 node cluster(for a total of 6), there is already about 500GB across 5 nodes. In order to distributed the data across the entire...
|
|
|
Author: Saptarshi Guha,
2010-01-09, 17:44
|
|
|
|