| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
1045 (0.124s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: HTTP file server, map output, and other files - MapReduce - [mail # user]
|
|
...YARN has a ShuffleHandler plugin used for MR purposes, but the APIs used here aren't "general"/public so you'd have to build your own utilities to do that. Its not too difficult to achieve b...
|
|
|
Author: Harsh J,
2013-05-24, 06:43
|
|
|
Re: Hadoop 2.0.4: Unable to load native-hadoop library for your platform - MapReduce - [mail # user]
|
|
...The native libraries packed in a binary tarball of 2.0.4 may not apply to all OSes and architectures. You will need to build your own native libraries to make sure they are appropriate for y...
|
|
|
Author: Harsh J,
2013-05-24, 06:24
|
|
|
Re: pauses during startup (maybe network related?) - MapReduce - [mail # user]
|
|
...You are spot on about the DNS lookup slowing things down. I've faced the same issue (before I had a local network DNS set up for the WiFi network I use). There's a few configs you nee...
|
|
|
Author: Harsh J,
2013-05-24, 05:29
|
|
|
Re: Task attempt failed after TaskAttemptListenerImpl ping - MapReduce - [mail # user]
|
|
...Assuming you mean "failed" there instead of "filed". In MR, a ping message is sent over the TaskUmbilicalProtocol from the Task container to the MR AM. A ping is only sent as an altern...
|
|
|
Author: Harsh J,
2013-05-24, 05:24
|
|
|
Re: SequenceFile sync marker uniqueness - MapReduce - [mail # user]
|
|
...SequenceFiles use a 16 digit MD5 (computed based on a UID and writer ~init time, so pretty random). For the rest of my answer, I'll prefer not to repeat what Martin's already said very well ...
|
|
|
Author: Harsh J,
2013-05-23, 19:53
|
|
|
Re: HDFS data and non-aligned splits - MapReduce - [mail # user]
|
|
...on block boundaries? Answer depends on the file format used here. With any of the formats we ship, nothing happens. boundaries, resulting in an extra HDFS connection just to get ...
|
|
|
Author: Harsh J,
2013-05-23, 19:09
|
|
|
Re: Hadoop Rack awareness on virtual system - MapReduce - [mail # user]
|
|
...An example topology file and script is available on the Wiki at http://wiki.apache.org/hadoop/topology_rack_awareness_scripts On Thu, May 23, 2013 at 8:38 PM, Jitendra Yadav wrote: &n...
|
|
|
Author: Harsh J,
2013-05-23, 15:30
|
|
|
Re: dncp_block_verification log - MapReduce - [mail # user]
|
|
...Hi, What is your HDFS version? I vaguely remember this to be a problem in the 2.0.0 version or so where there was also a block scanner excessive work bug, but I'm not sure what fixed i...
|
|
|
Author: Harsh J,
2013-05-23, 12:24
|
|
|
Re: How to handle multiline record for inputsplit? - MapReduce - [mail # dev]
|
|
...If your record is variably multi-line, then quite logically the newline character cannot be its "record delimiter". Use the right character or byte(s)/info that defines the real "record deli...
|
|
|
Author: Harsh J,
2013-05-21, 06:28
|
|
|
Re: Pluggable Block placement policy - MapReduce - [mail # user]
|
|
...Hi Mohammad, I believe we've already answered this earlier to an almost exact question: http://search-hadoop.com/m/b8FAa2eI6kj1. Does that not suffice? Is there something more specific...
|
|
|
Author: Harsh J,
2013-05-20, 07:09
|
|
|
|
