| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
99 (0.307s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...Look at NShotInputFormat call setNumberKeys to set the number of ants then change the method getValueFromIndex to return the text representing the original problem to each mapper - what happ...
|
|
|
Author: Steve Lewis,
2012-05-04, 20:15
|
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...On Fri, May 4, 2012 at 9:06 AM, sharat attupurath wrote: Write a custom splitter sending the same data to all mappers - the only critical criteria is the number of "Ants" You can...
|
|
|
Author: Steve Lewis,
2012-05-04, 16:22
|
|
|
Re: Debug MR tasks impossible. - MapReduce - [mail # user]
|
|
...You can run a job in local mode without a cluster and run in a debugger enabling breakpoints single stepping - examination of variables ... If you do this 1) Choose a SMALL problem 2) ...
|
|
|
Author: Steve Lewis,
2012-03-29, 16:32
|
|
|
Re: CSV files as input - MapReduce - [mail # user]
|
|
...Two other points - if you have several input files make a custom input whose reader make protected boolean isSplitable(JobContext context, Path file) return false and you do not have p...
|
|
|
Author: Steve Lewis,
2012-02-23, 00:13
|
|
|
Re: CSV files as input - MapReduce - [mail # user]
|
|
...It sounds like you may need to give up a little to make things work - Suppose, for example, that you placed a limit on the length of a quoted string, say 1024 characters - the reader can the...
|
|
|
Author: Steve Lewis,
2012-02-22, 22:59
|
|
|
Al ljobs fail with the erros - MapReduce - [mail # user]
|
|
...All of my current jobs and the wordcount I used when learning are all failing with the same error glados9.systemsbiology.net:50060/tasklog?plaintext=true&taskid=attempt_201202141331_00...
|
|
|
Author: Steve Lewis,
2012-02-14, 22:10
|
|
|
Re: Why it don't print anything into part-00000 file - MapReduce - [mail # user]
|
|
...1 run locally ether problem is small and until you can run a small local problem do not mover to the cluster. 2 make sure ether mapper writes something set a breakpoint at the write call. 3 ...
|
|
|
Author: Steve Lewis,
2012-01-31, 16:09
|
|
|
Re: distributing a time consuming single reduce task - MapReduce - [mail # user]
|
|
...It sounds like the HierarchicalClusterer whatever that is is doing what a collection of reducers should be doing - try to restructure the job so that the clustering is done more ...
|
|
|
Author: Steve Lewis,
2012-01-24, 02:09
|
|
|
Re: distributing a time consuming single reduce task - MapReduce - [mail # user]
|
|
...In general keeping the values you iterate through in memory in the inputSet is a bad idea - How many itens do you have and how large is inputSet when you finish. Y...
|
|
|
Author: Steve Lewis,
2012-01-23, 20:41
|
|
|
I am trying to run a large job and it is consistently failing with timeout - nothing happens for 600 sec - MapReduce - [mail # user]
|
|
...The map tasks fail timing out after 600 sec. I am processing one 9 GB file with 16,000,000 records. Each record (think is it as a line) generates hundreds of key value pairs. The job i...
|
|
|
Author: Steve Lewis,
2012-01-18, 22:05
|
|
|
|
