| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
213 (5.918s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Decommisioning runs for ever - Hadoop - [mail # user]
|
|
...Did you change the background bandwidth from 10mbs to something higher? Worst case is that you can kill the DN and wait 10 mins for the cluster to realize its down and then reba...
|
|
|
Author: Michael Segel,
2012-08-07, 01:06
|
|
|
Re: migrate cluster to different datacenter - Hadoop - [mail # user]
|
|
...Sorry at 1PB of disk... compression isn't going to really help a whole heck of a lot. Your networking bandwidth will be your bottleneck. So lets look at the problem. How m...
|
|
|
Author: Michael Segel,
2012-08-03, 21:57
|
|
|
Re: task jvm bootstrapping via distributed cache - Hadoop - [mail # user]
|
|
...Hi Stan, If I understood your question... you want to ship a jar to the nodes where the task will run prior to the start of the task? Not sure what it is you're trying to ...
|
|
|
Author: Michael Segel,
2012-07-31, 23:26
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...Sorry, but the OP was saying he had map/reduce job where the job had multiple reducers where he wanted to then combine the output to a single file. While you could merge th...
|
|
|
Author: Michael Segel,
2012-07-31, 20:44
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...You really don't want to run a single reducer unless you know that you don't have a lot of mappers. As long as the output data types and structure are the same as the inpu...
|
|
|
Author: Michael Segel,
2012-07-31, 12:24
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...Why not use a combiner? On Jul 30, 2012, at 7:59 PM, Mike S wrote: ...
|
|
|
Author: Michael Segel,
2012-07-31, 02:08
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...If the task fails the counter for that task is not used. So if you have speculative execution turned on and the JT kills a task, it won't affect your end results. A...
|
|
|
Author: Michael Segel,
2012-07-23, 23:06
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...Yup. Good post. On Jul 23, 2012, at 9:34 AM, Dave Shine wrote: Use the getCounter("MyRecords", "RecordTypeToCount").increment(1) whenever you find the type of record you ar...
|
|
|
Author: Michael Segel,
2012-07-23, 14:40
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...Look at using a dynamic counter. You don't need to set up or declare an enum. The only caveat is that counters are passed back to the JT by each task and are stored in mem...
|
|
|
Author: Michael Segel,
2012-07-23, 14:40
|
|
|
Re: Concurrency control - Hadoop - [mail # user]
|
|
...It goes beyond the atomic writes... There isn't the concept of transactions in HBase. He could also be talking about Hive, which would be appropriate for this mailing list...
|
|
|
Author: Michael Segel,
2012-07-18, 19:40
|
|
|
|
