| clear query|facets|time |
Search criteria: .
Results from 71 to 80 from
1045 (0.184s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Combine data from different HDFS FS - MapReduce - [mail # user]
|
|
...You should be able to add fully qualified HDFS paths from N clusters into the same job via FileInputFormat.addInputPath(…) calls. Caveats may apply for secure environments, but for non-secur...
|
|
|
Author: Harsh J,
2013-04-08, 17:34
|
|
|
Re: MapReduce on Local files - MapReduce - [mail # user]
|
|
...You've been misled by the GUI you use, I'm afraid. Many DEs (Desktop Environments) consider ~-suffix files as hidden but not the general standards (try ls for example, or even shell expansio...
|
|
|
Author: Harsh J,
2013-04-03, 09:58
|
|
|
Re: MapReduce on Local files - MapReduce - [mail # user]
|
|
...Not quite sure if I got your question. These tidbits may help though, from what I can understand: * LocalFileSystem's listing uses Java's APIs for file/dir listing, and has no concept ...
|
|
|
Author: Harsh J,
2013-04-03, 02:15
|
|
|
Re: Who splits the file into blocks - MapReduce - [mail # user]
|
|
...The client splits the file. The block size attribute is a per-file one, sent along with the file creation request. Blocks are requested as-it-goes, not pre-allocated. On Sun, Mar 31, 2...
|
|
|
Author: Harsh J,
2013-03-31, 17:20
|
|
|
[MAPREDUCE-4931] Add user-APIs for classpath precedence control - MapReduce - [issue]
|
|
...The feature config from MAPREDUCE-1938 of allowing tasks to start with user-classes-first is fairly popular and can use its own API hooks in Job/JobConf classes, making it easier to discover...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-4931
Author: Harsh J,
2013-03-29, 15:29
|
|
|
Re: FSDataOutputStream hangs in out.close() - MapReduce - [mail # user]
|
|
...Same data does not mean same block IDs across two clusters. I'm guessing this is cause of some issue in your code when wanting to write to two different HDFS instances with the same client. ...
|
|
|
Author: Harsh J,
2013-03-27, 17:55
|
|
|
Re: FSDataOutputStream hangs in out.close() - MapReduce - [mail # user]
|
|
...You can try to take a jstack stack trace and see what its hung on. I've only ever noticed a close() hang when the NN does not accept the complete-file call (due to minimum replication not be...
|
|
|
Author: Harsh J,
2013-03-27, 12:24
|
|
|
Re: Help on submitting a patch for an unassigned bug - MapReduce - [mail # dev]
|
|
...Hi Niranjan, You can work on these by submitting a patch directly to the ticket. A committer/reviewer will assign the issue to you the on first contribution time on each project, and t...
|
|
|
Author: Harsh J,
2013-03-26, 10:28
|
|
|
Re: Yarn Writing ApplicationMaster, Client Exception "URISyntaxException: Expected scheme name at index 0" - MapReduce - [mail # user]
|
|
...YARN does not seem to be checking for a fully qualified path when you pass it yours and ends up breaking. The problem is easily reproducible with the two transforming calls from ConverterUti...
|
|
|
Author: Harsh J,
2013-03-26, 00:29
|
|
|
Re: DataNode heartbeat average time peaks - MapReduce - [mail # user]
|
|
...Worst case if it puts too much strain: randomly failing clients and missing DN heartbeats leading to unnecessary dead node appearances. Worth using a release with HDFS-1457 in or patching yo...
|
|
|
Author: Harsh J,
2013-03-25, 16:32
|
|
|
|
