| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
99 (0.116s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue. - MapReduce - [mail # user]
|
|
...[We get 'There is insufficient memory for the Java Runtime Environment to continue.' any time we run any job including the most trivial word count process. It is true I am generating a jar f...
|
|
|
Author: Steve Lewis,
2012-10-05, 09:50
|
|
|
I need help defending the use of Hadoop on a mixed use cluster - MapReduce - [mail # user]
|
|
...Another lab has a cluster with about a thousand nodes. I have been using eight of their nodes for some hadoop development. Recently my group was offered the use of the entire cluster a...
|
|
|
Author: Steve Lewis,
2012-07-30, 15:32
|
|
|
Re: Map Reduce Theory Question, getting OutOfMemoryError while reducing - MapReduce - [mail # user]
|
|
...Use a custom partitioner and grouping comparator as described here http://pkghosh.wordpress.com/2011/04/13/map-reduce-secondary-sort-does-it-all/ in effect make the time part of the ke...
|
|
|
Author: Steve Lewis,
2012-06-29, 00:58
|
|
|
Re: Map Reduce Theory Question, getting OutOfMemoryError while reducing - MapReduce - [mail # user]
|
|
...It is NEVER a good idea to hold items in memory - after all this is big data and you want it to scale - I do not see what stops you from reading one record, processing it and writing it out ...
|
|
|
Author: Steve Lewis,
2012-06-28, 22:43
|
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...of course but do your reducers subclass org.apache.hadoop.mapreduce.Reducer or org.apache.hadoop.mapred.Reducer On Tue, May 8, 2012 at 8:32 AM, sharat attupurath wrote: St...
|
|
|
Author: Steve Lewis,
2012-05-08, 16:22
|
|
|
RE: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...Which api are you using? They changed between 0.18 and 0.20.this is the more recent version On May 8, 2012 3:55 AM, "sharat attupurath" wrote: ...
|
|
|
Author: Steve Lewis,
2012-05-08, 14:47
|
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...Fair enough - I write a lot of InputFormats since for most of my problems a line of text is not the proper unit - I read fasta files - read lines intil you hit a line starting with > and ...
|
|
|
Author: Steve Lewis,
2012-05-07, 16:24
|
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...Yes but it is the job of the InputFormat code to implement the behavior - it is not necessary to do so and in other cases I choose to create more mappers when the mapper has a lot of work &n...
|
|
|
Author: Steve Lewis,
2012-05-07, 15:17
|
|
|
RE: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...Look at what I sent you.it generates a number of splits three is a static variable to list how many On May 5, 2012 8:38 AM, "sharat attupurath" wrote: ...
|
|
|
Author: Steve Lewis,
2012-05-05, 20:16
|
|
|
Re: Ant Colony Optimization for Travelling Salesman Problem in Hadoop - MapReduce - [mail # user]
|
|
...yes - if you know how you can put it in distributed cache or if it is small put in as a String in the config or have all InputFormats read it from somewhere On Sat, May 5, 2012 at 8:08...
|
|
|
Author: Steve Lewis,
2012-05-05, 15:20
|
|
|
|
