| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
1036 (0.096s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: [VOTE] Plan to create release candidate for 0.23.8 - MapReduce - [mail # dev]
|
|
...+1 On Sat, May 18, 2013 at 2:40 AM, Thomas Graves wrote: Harsh J...
|
|
|
Author: Harsh J,
2013-05-18, 02:19
|
|
|
Re: recursive list in java without block - MapReduce - [mail # user]
|
|
...Hi Kun, So I think I was incorrect as I only checked the 0.20/1.0 APIs. We do have optimal recursive listing support in 2.0 for both FileContext and FileSystem APIs: http://hadoo...
|
|
|
Author: Harsh J,
2013-05-17, 09:52
|
|
|
Re: recursive list in java without block - MapReduce - [mail # user]
|
|
...The FileSystem API doesn't provide a utility to do recursive listing yet, so you'd have to build it on your own. MR and the Fs Shell, both do seem to have inbuilt support for such a ut...
|
|
|
Author: Harsh J,
2013-05-16, 22:59
|
|
|
Re: Hadoop running the incorrect class - MapReduce - [mail # user]
|
|
...Check your "hadoop classpath" output - check on the output if your jar was placed on it directly. Alternatively, use a tool such as https://github.com/mreid-moz/JarFinder, etc. to help...
|
|
|
Author: Harsh J,
2013-05-16, 22:56
|
|
|
Re: Question about writing HDFS files - MapReduce - [mail # user]
|
|
...That is not true. HDFS writes are not staged to a local disk first before being written onto the DataNodes. The old architecture docs seem to suggest that the writes get staged to a local di...
|
|
|
Author: Harsh J,
2013-05-16, 22:53
|
|
|
Re: Question on HDFS_BYTES_READ and HDFS_BYTES_WRITTEN - MapReduce - [mail # user]
|
|
...Hi Jim, The counters you're looking at are counted at the FileSystem interface level, not at the more specific Task level (which have "map input bytes" and such). This means that...
|
|
|
Author: Harsh J,
2013-05-16, 07:56
|
|
|
Re: Map Tasks do not obey data locality principle........ - MapReduce - [mail # user]
|
|
...Hi Nikhil, For (1) - Its hard to specifically tell what you may be doing wrong or differently than expected cause I don't have the source to look it up, but do you at least see the JT ...
|
|
|
Author: Harsh J,
2013-05-16, 06:52
|
|
|
Re: Map Tasks do not obey data locality principle........ - MapReduce - [mail # user]
|
|
...The scheduling is done based on block locations filled in by the input splits. If there's no hints being provided by your FS, then the result you're seeing is correct. Note that if you...
|
|
|
Author: Harsh J,
2013-05-16, 06:17
|
|
|
Re: Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Do you see viewfs mounts coming useful there (i.e. in place of hardlinks across NSes)? On Thu, May 16, 2013 at 3:49 AM, Michael Segel wrote: Harsh J...
|
|
|
Author: Harsh J,
2013-05-16, 05:14
|
|
|
Re: Question about Name Spaces… - MapReduce - [mail # user]
|
|
...Namespace divides are designed with application-level separation in mind. Sharing a file across namespaces does not make a whole lot of sense to me. Anyhow, the data is on the same set...
|
|
|
Author: Harsh J,
2013-05-15, 18:30
|
|
|
|
