| clear query|facets|time |
Search criteria: .
Results from 161 to 170 from
321 (0.392s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: TeraSort question. - Hadoop - [mail # user]
|
|
...Raj, Do you have the job history files? That would be very useful. I would be happy to create some swimlane and related graphs for you if you can send me the history files....
|
|
|
Author: Ted Dunning,
2011-01-11, 16:22
|
|
|
Re: Import data from mysql - Hadoop - [mail # user]
|
|
...Yes. Hadoop can definitely help with this. On Mon, Jan 10, 2011 at 12:00 PM, Brian wrote: ...
|
|
|
Author: Ted Dunning,
2011-01-10, 21:51
|
|
|
Re: Import data from mysql - Hadoop - [mail # user]
|
|
...You still have to knock down the quadratic cost. Any equality checks you have in your problem can be used to limit the problem to growing quadratically in the number of records equal b...
|
|
|
Author: Ted Dunning,
2011-01-09, 21:18
|
|
|
Re: Import data from mysql - Hadoop - [mail # user]
|
|
...It is, of course, only quadratic, even if you compare all rows to all other rows. You can reduce this cost to O(n log n) by ordinary sorting and you can reduce further reduce the cost ...
|
|
|
Author: Ted Dunning,
2011-01-09, 08:55
|
|
|
Re: Rngd - Hadoop - [mail # user]
|
|
...As it normally stands, rngd will only help (it appears) if you have a hardware RNG. You need to cheat and use entropy you don't really have. If you don't mind hacking your system...
|
|
|
Author: Ted Dunning,
2011-01-04, 22:22
|
|
|
Re: Entropy Pool and HDFS FS Commands Hanging System - Hadoop - [mail # user]
|
|
...On Mon, Jan 3, 2011 at 4:48 PM, Jon Lederman wrote: I tried to send you a highlighted markup of your jstack output. The key thing to look for is some thread reading...
|
|
|
Author: Ted Dunning,
2011-01-04, 01:23
|
|
|
Re: Entropy Pool and HDFS FS Commands Hanging System - Hadoop - [mail # user]
|
|
...try dd if=/dev/random bs=1 count=100 of=/dev/null This will likely hang for a long time. There is no way that I know of to change the behavior of /dev/random except...
|
|
|
Author: Ted Dunning,
2011-01-04, 00:41
|
|
|
Re: What is the runtime efficiency of secondary sorting? - Hadoop - [mail # user]
|
|
...On Mon, Jan 3, 2011 at 4:00 PM, W.P. McNeill wrote: The definitive answer is that it depends. If you can define a binary comparator for your value field that extra...
|
|
|
Author: Ted Dunning,
2011-01-04, 00:10
|
|
|
Re: Entropy Pool and HDFS FS Commands Hanging System - Hadoop - [mail # user]
|
|
...Yes. It is stuck as suggested. See the bolded lines. You can help avoid this by dumping additional entropy into the machine via network traffic. According to the man ...
|
|
|
Author: Ted Dunning,
2011-01-03, 23:48
|
|
|
Re: What is the runtime efficiency of secondary sorting? - Hadoop - [mail # user]
|
|
...As a point of order, you would normally use a combiner with this problem and you wouldn't sort in either the combiner or the reducer. Instead, combiner and reducer would simply scan an...
|
|
|
Author: Ted Dunning,
2011-01-03, 23:12
|
|
|
|
