| clear query|facets|time |
Search criteria: .
Results from 91 to 100 from
1068 (0.125s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: DataNode Report Questions - MapReduce - [mail # user]
|
|
...Raujin, See this thread that came up only a few days ago: http://search-hadoop.com/m/AuKb32E4Pjr1 On Thu, Apr 11, 2013 at 7:08 AM, rauljin wrote: Harsh J...
|
|
|
Author: Harsh J,
2013-04-11, 02:42
|
|
|
Re: Need help, Can I disable datanode block report? - MapReduce - [mail # user]
|
|
...Xibin, I'd recommend upgrading. This was addressed quite a while ago with HDFS-2379. On Wed, Apr 10, 2013 at 1:35 PM, Xibin Liu wrote: Harsh J...
|
|
|
Author: Harsh J,
2013-04-10, 08:18
|
|
|
Re: Best format to use - MapReduce - [mail # user]
|
|
...Pig and Hive both have support for compressed sequence files. Regarding best format - if its just text log data (i.e. no types/structure) then the best format to keep it in is in text+...
|
|
|
Author: Harsh J,
2013-04-09, 17:25
|
|
|
Re: regarding hadoop - MapReduce - [mail # user]
|
|
...Hi, This is most likely caused by an improper network environment wherein the reducer is not able to resolve all available tasktrackers to read the map outputs. Check the logs of the t...
|
|
|
Author: Harsh J,
2013-04-09, 12:52
|
|
|
Re: Combine data from different HDFS FS - MapReduce - [mail # user]
|
|
...You should be able to add fully qualified HDFS paths from N clusters into the same job via FileInputFormat.addInputPath(…) calls. Caveats may apply for secure environments, but for non-secur...
|
|
|
Author: Harsh J,
2013-04-08, 17:34
|
|
|
Re: MapReduce on Local files - MapReduce - [mail # user]
|
|
...You've been misled by the GUI you use, I'm afraid. Many DEs (Desktop Environments) consider ~-suffix files as hidden but not the general standards (try ls for example, or even shell expansio...
|
|
|
Author: Harsh J,
2013-04-03, 09:58
|
|
|
Re: MapReduce on Local files - MapReduce - [mail # user]
|
|
...Not quite sure if I got your question. These tidbits may help though, from what I can understand: * LocalFileSystem's listing uses Java's APIs for file/dir listing, and has no concept ...
|
|
|
Author: Harsh J,
2013-04-03, 02:15
|
|
|
Re: Who splits the file into blocks - MapReduce - [mail # user]
|
|
...The client splits the file. The block size attribute is a per-file one, sent along with the file creation request. Blocks are requested as-it-goes, not pre-allocated. On Sun, Mar 31, 2...
|
|
|
Author: Harsh J,
2013-03-31, 17:20
|
|
|
Re: FSDataOutputStream hangs in out.close() - MapReduce - [mail # user]
|
|
...Same data does not mean same block IDs across two clusters. I'm guessing this is cause of some issue in your code when wanting to write to two different HDFS instances with the same client. ...
|
|
|
Author: Harsh J,
2013-03-27, 17:55
|
|
|
Re: FSDataOutputStream hangs in out.close() - MapReduce - [mail # user]
|
|
...You can try to take a jstack stack trace and see what its hung on. I've only ever noticed a close() hang when the NN does not accept the complete-file call (due to minimum replication not be...
|
|
|
Author: Harsh J,
2013-03-27, 12:24
|
|
|
|
