|
|
-
A slave knows the other in hadoop?
Sandro Simas 2011-02-16, 18:19
This is a simple question, a slave know the other slave in Hadoop ? Need i put the public key of the first slave in authorized_keys of the second ? In /etc/hosts file, i have to put all ips and names of cluster nodes? [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] * www.jusbrasil.com.br * * Sandro Simas * * Equipe JusBrasil * * [EMAIL PROTECTED] * (71) 3389-5204 / (71) 9966-1020
-
Re: A slave knows the other in hadoop?
Ted Yu 2011-02-16, 18:23
>> Need i put the public key of the first slave in authorized_keys of the second ?
That is not needed.
On Wed, Feb 16, 2011 at 10:19 AM, Sandro Simas <[EMAIL PROTECTED]>wrote:
> This is a simple question, a slave know the other slave in Hadoop ? > Need i put the public key of the first slave in authorized_keys of the > second ? > In /etc/hosts file, i have to put all ips and names of cluster nodes? > [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] * > www.jusbrasil.com.br * * Sandro Simas * > * Equipe JusBrasil * > * [EMAIL PROTECTED] * > (71) 3389-5204 / (71) 9966-1020 >
-
Re: A slave knows the other in hadoop?
Sandro Simas 2011-02-16, 18:42
and the others questions ?
why when i try to insert a node in cluster when a mapreduce runs the reduce stay in the same value forever ?
11/02/16 15:33:52 INFO mapred.FileInputFormat: Total input paths to process : 100 11/02/16 15:33:53 INFO mapred.JobClient: Running job: job_201102161502_0005 11/02/16 15:33:54 INFO mapred.JobClient: map 0% reduce 0% 11/02/16 15:34:02 INFO mapred.JobClient: map 1% reduce 0% 11/02/16 15:34:03 INFO mapred.JobClient: map 7% reduce 0% 11/02/16 15:34:05 INFO mapred.JobClient: map 9% reduce 0% 11/02/16 15:34:06 INFO mapred.JobClient: map 16% reduce 0% 11/02/16 15:34:08 INFO mapred.JobClient: map 18% reduce 0% 11/02/16 15:34:09 INFO mapred.JobClient: map 24% reduce 0% 11/02/16 15:34:11 INFO mapred.JobClient: map 26% reduce 0% 11/02/16 15:34:12 INFO mapred.JobClient: map 31% reduce 3% 11/02/16 15:34:14 INFO mapred.JobClient: map 33% reduce 3% 11/02/16 15:34:15 INFO mapred.JobClient: map 39% reduce 3% 11/02/16 15:34:17 INFO mapred.JobClient: map 41% reduce 3% 11/02/16 15:34:18 INFO mapred.JobClient: map 47% reduce 3% 11/02/16 15:34:20 INFO mapred.JobClient: map 49% reduce 3% 11/02/16 15:34:21 INFO mapred.JobClient: map 55% reduce 7% 11/02/16 15:34:23 INFO mapred.JobClient: map 57% reduce 7% 11/02/16 15:34:24 INFO mapred.JobClient: map 63% reduce 7% 11/02/16 15:34:26 INFO mapred.JobClient: map 65% reduce 7% 11/02/16 15:34:27 INFO mapred.JobClient: map 71% reduce 13% 11/02/16 15:34:29 INFO mapred.JobClient: map 73% reduce 13% 11/02/16 15:34:30 INFO mapred.JobClient: map 79% reduce 13% 11/02/16 15:34:32 INFO mapred.JobClient: map 81% reduce 13% 11/02/16 15:34:33 INFO mapred.JobClient: map 87% reduce 13% 11/02/16 15:34:35 INFO mapred.JobClient: map 89% reduce 13% 11/02/16 15:34:36 INFO mapred.JobClient: map 95% reduce 17% 11/02/16 15:34:38 INFO mapred.JobClient: map 97% reduce 17% 11/02/16 15:34:39 INFO mapred.JobClient: map 100% reduce 17% 11/02/16 15:34:42 INFO mapred.JobClient: map 100% reduce 23% 11/02/16 15:34:51 INFO mapred.JobClient: map 100% reduce 24%
I think that is the Shuffling Phase. On Wed, Feb 16, 2011 at 3:23 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >> Need i put the public key of the first slave in authorized_keys of the > second ? > > That is not needed. > > On Wed, Feb 16, 2011 at 10:19 AM, Sandro Simas <[EMAIL PROTECTED] > >wrote: > > > This is a simple question, a slave know the other slave in Hadoop ? > > Need i put the public key of the first slave in authorized_keys of the > > second ? > > In /etc/hosts file, i have to put all ips and names of cluster nodes? > > [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] * > > www.jusbrasil.com.br * * Sandro Simas * > > * Equipe JusBrasil * > > * [EMAIL PROTECTED] * > > (71) 3389-5204 / (71) 9966-1020 > > > [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] * www.jusbrasil.com.br * * Sandro Simas * * Equipe JusBrasil * * [EMAIL PROTECTED] * (71) 3389-5204 / (71) 9966-1020
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext