| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
211 (0.156s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: task jvm bootstrapping via distributed cache - Hadoop - [mail # user]
|
|
...Hi Stan, If I understood your question... you want to ship a jar to the nodes where the task will run prior to the start of the task? Not sure what it is you're trying to ...
|
|
|
Author: Michael Segel,
2012-07-31, 23:26
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...Sorry, but the OP was saying he had map/reduce job where the job had multiple reducers where he wanted to then combine the output to a single file. While you could merge th...
|
|
|
Author: Michael Segel,
2012-07-31, 20:44
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...You really don't want to run a single reducer unless you know that you don't have a lot of mappers. As long as the output data types and structure are the same as the inpu...
|
|
|
Author: Michael Segel,
2012-07-31, 12:24
|
|
|
Re: Merge Reducers Output - Hadoop - [mail # user]
|
|
...Why not use a combiner? On Jul 30, 2012, at 7:59 PM, Mike S wrote: ...
|
|
|
Author: Michael Segel,
2012-07-31, 02:08
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...If the task fails the counter for that task is not used. So if you have speculative execution turned on and the JT kills a task, it won't affect your end results. A...
|
|
|
Author: Michael Segel,
2012-07-23, 23:06
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...Yup. Good post. On Jul 23, 2012, at 9:34 AM, Dave Shine wrote: Use the getCounter("MyRecords", "RecordTypeToCount").increment(1) whenever you find the type of record you ar...
|
|
|
Author: Michael Segel,
2012-07-23, 14:40
|
|
|
Re: Counting records - Hadoop - [mail # user]
|
|
...Look at using a dynamic counter. You don't need to set up or declare an enum. The only caveat is that counters are passed back to the JT by each task and are stored in mem...
|
|
|
Author: Michael Segel,
2012-07-23, 14:40
|
|
|
Re: Concurrency control - Hadoop - [mail # user]
|
|
...It goes beyond the atomic writes... There isn't the concept of transactions in HBase. He could also be talking about Hive, which would be appropriate for this mailing list...
|
|
|
Author: Michael Segel,
2012-07-18, 19:40
|
|
|
Re: Hive/Hdfs Connector - Hadoop - [mail # user]
|
|
...Have you tried using Hive's thrift server? On Jul 5, 2012, at 10:20 AM, Sandeep Reddy P wrote: ...
|
|
|
Author: Michael Segel,
2012-07-05, 15:26
|
|
|
Re: Multiple cores vs multiple nodes - Hadoop - [mail # user]
|
|
...Hi, First, you have to explain what you mean by 'equivalent' . The short answer is that it depends. The longer answer is that you have to consider cost in your design. The whol...
|
|
|
Author: Michael Segel,
2012-07-02, 12:08
|
|
|
|
