| clear query|facets|time |
Search criteria: .
Results from 71 to 80 from
142 (0.109s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Speculative execution - Hadoop - [mail # user]
|
|
...I realize that the intended purpose of speculative execution is to overcome individual slow tasks...and I have read that it explicitly is *not* intended to start copies of a task...
|
|
|
Author: Keith Wiley,
2011-03-02, 21:01
|
|
|
Streaming cmd-line args? - Hadoop - [mail # user]
|
|
...All-Java Hadoop programs can receive command-line arguments to the driver program simply listing options at run time that aren't prepended with a recognized Hadoop flag (-file or...
|
|
|
Author: Keith Wiley,
2011-02-15, 17:41
|
|
|
Re: Multiple various streaming questions - Hadoop - [mail # user]
|
|
...On Feb 7, 2011, at 13:39 , Allen Wittenauer wrote: [On the topic of why I care if Hadoop funnels and queues multiple input splits into a a small number mappers instead of perfec...
|
|
|
Author: Keith Wiley,
2011-02-07, 23:39
|
|
|
Linear slowdown producing streaming output - Hadoop - [mail # user]
|
|
...I noticed that it takes much longer to write 55 MBs to a streaming output than it takes to write 12 MBs (much more than 4-5X longer), so I broke the output up, writing 1 MB at a ...
|
|
|
Author: Keith Wiley,
2011-02-05, 04:07
|
|
|
Override automatica final streaming job status message? - Hadoop - [mail # user]
|
|
...Streaming tasks seem to get a final status message from Hadoop itself (not my code) that reports "R/W", presumably the number of records read and written (the number of lines of ...
|
|
|
Author: Keith Wiley,
2011-02-04, 22:49
|
|
|
Re: Multiple various streaming questions - Hadoop - [mail # user]
|
|
...On Feb 4, 2011, at 07:46 , Keith Wiley wrote: queueing up? Also keep in mind that if a node fails, that work will need to get re-done anyway. excruciating that Hadoop parti...
|
|
|
Author: Keith Wiley,
2011-02-04, 16:50
|
|
|
Re: Multiple various streaming questions - Hadoop - [mail # user]
|
|
...That's weird. I thought I responded to this, but I don't see one on the list (and have vague recollection at best of whether I actually did respond)...anyway... On Fe...
|
|
|
Author: Keith Wiley,
2011-02-04, 15:46
|
|
|
Re: Streaming data locality - Hadoop - [mail # user]
|
|
...On Feb 3, 2011, at 6:25 PM, Allen Wittenauer wrote: doing. -cache is used for sending files with your job and should have no bearing on what your input is to your job. &nbs...
|
|
|
Author: Keith Wiley,
2011-02-04, 07:03
|
|
|
Re: Streaming data locality - Hadoop - [mail # user]
|
|
...On Feb 3, 2011, at 6:25 PM, Allen Wittenauer wrote: HDFS file names which are then read by the mappers, then how can data locality be achieved. matter. The JobTracker place...
|
|
|
Author: Keith Wiley,
2011-02-04, 03:56
|
|
|
Re: Streaming data locality - Hadoop - [mail # user]
|
|
...On Feb 3, 2011, at 9:46 AM, Harsh J wrote: wrote: HDFS file names which are then read by the mappers, then how can data locality be achieved. The files won't be split, they...
|
|
|
Author: Keith Wiley,
2011-02-04, 03:52
|
|
|
|
