| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
1041 (0.274s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: SequenceFile sync marker uniqueness - MapReduce - [mail # user]
|
|
...SequenceFiles use a 16 digit MD5 (computed based on a UID and writer ~init time, so pretty random). For the rest of my answer, I'll prefer not to repeat what Martin's already said very well ...
|
|
|
Author: Harsh J,
2013-05-23, 19:53
|
|
|
Re: HDFS data and non-aligned splits - MapReduce - [mail # user]
|
|
...on block boundaries? Answer depends on the file format used here. With any of the formats we ship, nothing happens. boundaries, resulting in an extra HDFS connection just to get ...
|
|
|
Author: Harsh J,
2013-05-23, 19:09
|
|
|
Re: Hadoop Rack awareness on virtual system - MapReduce - [mail # user]
|
|
...An example topology file and script is available on the Wiki at http://wiki.apache.org/hadoop/topology_rack_awareness_scripts On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav wrote: &n...
|
|
|
Author: Harsh J,
2013-05-23, 15:30
|
|
|
Re: dncp_block_verification log - MapReduce - [mail # user]
|
|
...Hi, What is your HDFS version? I vaguely remember this to be a problem in the 2.0.0 version or so where there was also a block scanner excessive work bug, but I'm not sure what fixed i...
|
|
|
Author: Harsh J,
2013-05-23, 12:24
|
|
|
Re: How to handle multiline record for inputsplit? - MapReduce - [mail # dev]
|
|
...If your record is variably multi-line, then quite logically the newline character cannot be its "record delimiter". Use the right character or byte(s)/info that defines the real "record deli...
|
|
|
Author: Harsh J,
2013-05-21, 06:28
|
|
|
Re: Pluggable Block placement policy - MapReduce - [mail # user]
|
|
...Hi Mohammad, I believe we've already answered this earlier to an almost exact question: http://search-hadoop.com/m/b8FAa2eI6kj1. Does that not suffice? Is there something more specific...
|
|
|
Author: Harsh J,
2013-05-20, 07:09
|
|
|
Re: recursive list in java without block - MapReduce - [mail # user]
|
|
...Hi Kun, So I think I was incorrect as I only checked the 0.20/1.0 APIs. We do have optimal recursive listing support in 2.0 for both FileContext and FileSystem APIs: http://hadoo...
|
|
|
Author: Harsh J,
2013-05-17, 09:52
|
|
|
Re: recursive list in java without block - MapReduce - [mail # user]
|
|
...The FileSystem API doesn't provide a utility to do recursive listing yet, so you'd have to build it on your own. MR and the Fs Shell, both do seem to have inbuilt support for such a ut...
|
|
|
Author: Harsh J,
2013-05-16, 22:59
|
|
|
Re: Hadoop running the incorrect class - MapReduce - [mail # user]
|
|
...Check your "hadoop classpath" output - check on the output if your jar was placed on it directly. Alternatively, use a tool such as https://github.com/mreid-moz/JarFinder, etc. to help...
|
|
|
Author: Harsh J,
2013-05-16, 22:56
|
|
|
Re: Question about writing HDFS files - MapReduce - [mail # user]
|
|
...That is not true. HDFS writes are not staged to a local disk first before being written onto the DataNodes. The old architecture docs seem to suggest that the writes get staged to a local di...
|
|
|
Author: Harsh J,
2013-05-16, 22:53
|
|
|
|
