| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
142 (0.073s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Force job to use all reducers evenly? - Hadoop - [mail # user]
|
|
...On Mar 25, 2011, at 2:02 AM, Harsh J wrote: wrote: designate the job to have at least (or precisely) 4 reducers. I have noticed that it is not guaranteed that all four redu...
|
|
|
Author: Keith Wiley,
2011-03-25, 14:18
|
|
|
Force job to use all reducers evenly? - Hadoop - [mail # user]
|
|
...Say my mappers produce at most (or precisely) 4 output keys. Say I designate the job to have at least (or precisely) 4 reducers. I have noticed that it is not guarant...
|
|
|
Author: Keith Wiley,
2011-03-25, 07:18
|
|
|
Re: Direct HDFS access from a streaming job - Hadoop - [mail # user]
|
|
...On Mar 24, 2011, at 8:31 AM, Harsh J wrote: wrote: quoted in my first post, the unstated intent was to simply do a system() call and invoke "hadoop fs -get" or "hadoop fs -copyTo...
|
|
|
Author: Keith Wiley,
2011-03-24, 16:09
|
|
|
Re: Direct HDFS access from a streaming job - Hadoop - [mail # user]
|
|
...On Mar 23, 2011, at 11:10 PM, Harsh J wrote: Thanks. Actually, I think that with reference to the passage I quoted in my first post, the unstated intent was to simpl...
|
|
|
Author: Keith Wiley,
2011-03-24, 15:15
|
|
|
Direct HDFS access from a streaming job - Hadoop - [mail # user]
|
|
...This webpage: http://hadoop.apache.org/common/docs/r0.18.3/streaming.html contains this passage: [BEGIN] How do I process files, one per map? As an example, consider ...
|
|
|
Author: Keith Wiley,
2011-03-24, 05:26
|
|
|
Re: kill-task syntax? - Hadoop - [mail # user]
|
|
...On Mar 23, 2011, at 2:02 PM, Keith Wiley wrote: the job tracker? Killing a job generally works for me........although much to my dismay the job often doesn't actually die, ...
|
|
|
Author: Keith Wiley,
2011-03-23, 22:04
|
|
|
kill-task syntax? - Hadoop - [mail # user]
|
|
...hadoop job -kill-task and -fail-task don't work for me. I get this kind of error: Exception in thread "main" java.lang.IllegalArgumentException: TaskAttemptId string ...
|
|
|
Author: Keith Wiley,
2011-03-23, 21:02
|
|
|
Re: Streaming reporter counter vs status - Hadoop - [mail # user]
|
|
...I suppose this bit of documentation answers part of my question: 'The number of milliseconds before a task will be terminated if it neither reads an input, writes an output, nor ...
|
|
|
Author: Keith Wiley,
2011-03-23, 18:57
|
|
|
Re: Streaming mappers frequently time out - Hadoop - [mail # user]
|
|
...Maybe I could just turn it down to two or three minutes. It wouldn't fix the problem where the task doesn't start, but it would kill it and restart it more quickly. T...
|
|
|
Author: Keith Wiley,
2011-03-23, 18:49
|
|
|
Re: Streaming mappers frequently time out - Hadoop - [mail # user]
|
|
...On Mar 23, 2011, at 10:33 AM, Keith Wiley wrote: thread sends periodic reporter and status messages to cout using the streaming reporter syntax, but I still get these errors occa...
|
|
|
Author: Keith Wiley,
2011-03-23, 18:04
|
|
|
|
