| clear query|facets|time |
Search criteria: .
Results from 91 to 100 from
1035 (0.128s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: executing files on hdfs via hadoop not possible? is JNI/JNA a reasonable solution? - MapReduce - [mail # user]
|
|
...Hi, Yes, streaming lets you send in arbitrary programs and execute them upon the input and helps collect the output, such as a shell script or a python script (its agnostic to what you...
|
|
|
Author: Harsh J,
2013-03-17, 13:28
|
|
|
Re: executing files on hdfs via hadoop not possible? is JNI/JNA a reasonable solution? - MapReduce - [mail # user]
|
|
...You're confusing two things here. HDFS is a data storage filesystem. MR does not have anything to do with HDFS (generally speaking). A reducer runs as a regular JVM on a provided node,...
|
|
|
Author: Harsh J,
2013-03-17, 09:50
|
|
|
Re: Hadoop Common API docs - MapReduce - [mail # user]
|
|
...The RunJar class's API isn't for "public" consumption, and is an internal class of Apache Hadoop, which may explain its lack of public facing docs. Its implementation however, is simple enou...
|
|
|
Author: Harsh J,
2013-03-17, 00:04
|
|
|
Re: Increase the number of mappers in PM mode - MapReduce - [mail # user]
|
|
...In MR2, to have more mappers executed per NM, your memory request for each map should be set such that the NM's configured memory allowance can fit in multiple requests. For example, if my N...
|
|
|
Author: Harsh J,
2013-03-17, 00:00
|
|
|
Re: Need info on mapred.child.java.opts, mapred.map.child.java.opts and mapred.reduce.child.java.opts - MapReduce - [mail # user]
|
|
...Its easier to understand if you know the history. First there was just "mapred.child.java.opts", which controlled java options for both Map and Reduce tasks (i.e. all tasks). Then there came...
|
|
|
Author: Harsh J,
2013-03-08, 11:13
|
|
|
Re: OutOfMemory during Plain Java MapReduce - MapReduce - [mail # user]
|
|
...Hi, When you implement code that starts memory-storing value copies for every record (even if of just a single key), things are going to break in big-data-land. Practically, post-parti...
|
|
|
Author: Harsh J,
2013-03-08, 10:57
|
|
|
Re: unable to get simple hadoop streaming example to run - MapReduce - [mail # user]
|
|
...An error such as "/home/cloudera/multifetch.py": java.io.IOException: error=13, Permission denied would mean that either the file lacked an executable bit (chmod +x the file), or that the mo...
|
|
|
Author: Harsh J,
2013-03-08, 00:29
|
|
|
Re: Best practices for adding services to Hadoop cluster? - MapReduce - [mail # user]
|
|
...The only thing wrong would be what is said for the DB-talking jobs as well: Distributed mappers talking to a single point of service can bring it down. On Thu, Mar 7, 2013 at 10:59 AM,...
|
|
|
Author: Harsh J,
2013-03-07, 05:59
|
|
|
Re: HDFS network traffic - MapReduce - [mail # user]
|
|
...Yes, the simple copy is a client operation. Client reads bytes from source and writes to the destination, thereby being in control of failures, etc.. However, if you want your cluster to do ...
|
|
|
Author: Harsh J,
2013-03-07, 05:23
|
|
|
Re: dfs.datanode.du.reserved - MapReduce - [mail # user]
|
|
...Hey John, Ideas, comments and patches are welcome on https://issues.apache.org/jira/browse/HDFS-1564 for achieving this! On Wed, Mar 6, 2013 at 9:56 PM, John Meza wrote: &...
|
|
|
Author: Harsh J,
2013-03-07, 01:07
|
|
|
|
