| clear query|facets|time |
Search criteria: .
Results from 81 to 90 from
142 (0.059s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Streaming data locality - Hadoop - [mail # user]
|
|
...On Feb 3, 2011, at 9:29 AM, David Rosenstrauch wrote: loop where you repeatedly call job.addInputPath. (Or, if you're going to have a large number of input files, use Combi...
|
|
|
Author: Keith Wiley,
2011-02-04, 03:45
|
|
|
Streaming data locality - Hadoop - [mail # user]
|
|
...I've seen this asked before, but haven't seen a response yet. If the input to a streaming job is not actual data splits but simple HDFS file names which are then read by the mapp...
|
|
|
Author: Keith Wiley,
2011-02-03, 17:16
|
|
|
Multiple various streaming questions - Hadoop - [mail # user]
|
|
...I would really appreciate any help people can offer on the following matters. When running a streaming job, -D, -files, -libjars, and -archives don't seem work, but -jobcon...
|
|
|
Author: Keith Wiley,
2011-02-02, 07:40
|
|
|
Managing stdout in streaming - Hadoop - [mail # user]
|
|
...So streaming uses stdout to organize the mapper/reducer output, one record per line with each key/val split at the first TAB. (Presumably multiple TABS are permitted and become e...
|
|
|
Author: Keith Wiley,
2011-02-01, 20:55
|
|
|
Re: Streaming reporter counter update - Hadoop - [mail # user]
|
|
...Ah, so count doesn't "set" the count, it increments it, meaning I shouldn't increment it each time. That would result in some sort of strange exponential counter. I s...
|
|
|
Author: Keith Wiley,
2011-02-01, 20:47
|
|
|
Streaming reporter counter update - Hadoop - [mail # user]
|
|
...I have found the following abstraction a streaming counter update in many places on the web: "reporter:counter:,," to be sent to cerr, but I haven't found a description of...
|
|
|
Author: Keith Wiley,
2011-02-01, 20:11
|
|
|
Streaming with user-defined Java driver - Hadoop - [mail # user]
|
|
...I would like to use streaming for the mapper and reducer but in such a way that I still get to do the usual Hadoop setup in Java, the usual Java arrangement, like this: pub...
|
|
|
Author: Keith Wiley,
2011-01-29, 21:14
|
|
|
Sending cachefiles back from streaming interface - Hadoop - [mail # user]
|
|
...Looks like I can use -cacheFile or DistributedCache.addCacheFile() to send read-only files (on HDFS) to mappers and reducers. This is particularly useful for streaming mapp...
|
|
|
Author: Keith Wiley,
2011-01-29, 18:33
|
|
|
Re: Thread safety issues with JNI/native code from map tasks? - Hadoop - [mail # user]
|
|
...Hmmm, none of my native code is using JNI objects, so the memory in question should have no relationship to the Java heap or any other aspect of the Java world, but I admit, I'm ...
|
|
|
Author: Keith Wiley,
2011-01-29, 01:49
|
|
|
Re: Thread safety issues with JNI/native code from map tasks? - Hadoop - [mail # user]
|
|
...On Jan 28, 2011, at 15:50 , Greg Roelofs wrote: other safe other much Yeah, I dunno. It's a very complicated system that hits all kinds of popular conventional librar...
|
|
|
Author: Keith Wiley,
2011-01-29, 01:47
|
|
|
|
