| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
99 (0.123s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Running Hadoop client as a different user - MapReduce - [mail # user]
|
|
...I have been running Hadoop on a clister set to not check permissions. I would run a java client on my local machine and would run as the local user on the cluster. I say * ...
|
|
|
Author: Steve Lewis,
2013-05-12, 19:42
|
|
|
Re: How to process only input files containing 100% valid rows - MapReduce - [mail # user]
|
|
...With files that small it is much better to write a custom input format which checks the entire file and only passes records from good files. If you need Hadoop you are probably processing a ...
|
|
|
Author: Steve Lewis,
2013-04-18, 21:50
|
|
|
Re: Querying a Prolog Server from a JVM during a MapReduce Job - MapReduce - [mail # user]
|
|
...Assuming that the server can handle high volume and multiple queries there is no reason not to run it on a large and powerful machine outside the cluster. Nothing prevents your mappers from ...
|
|
|
Author: Steve Lewis,
2013-04-16, 21:01
|
|
|
Re: Java jars and MapReduce - MapReduce - [mail # user]
|
|
...A few basic questions - 1) is the rate limiting step the Java processing or storage in accumulo. Hadoop may not be able to speed up a database which is not designed to work in a distributed ...
|
|
|
Author: Steve Lewis,
2013-03-02, 04:21
|
|
|
What resources are used by idle NameNode and JobTracker tasks - MapReduce - [mail # user]
|
|
...I have Hadoop running on 8 nodes in a 50 node cluster. The NameNode and Jobtrackers have been running for months while jobs were run occasionally - usually no more than a dozen a week and mo...
|
|
|
Author: Steve Lewis,
2013-02-11, 18:07
|
|
|
Re: Running from a client machine does not work under 1.03 - MapReduce - [mail # user]
|
|
...The immediate problem is an access exception - users like Asterix\Steve - completely unknown to the file system cannot write files or directories. There is another error "I...
|
|
|
Author: Steve Lewis,
2012-12-08, 02:17
|
|
|
Running from a client machine does not work under 1.03 - MapReduce - [mail # user]
|
|
...I have been running Hadoop jobs from my local box - on the net but outside the cluster. Configuration conf = new Configuration(); String jarfil...
|
|
|
Author: Steve Lewis,
2012-12-07, 18:19
|
|
|
File permissions in HDFS - MapReduce - [mail # user]
|
|
... I am running Hadoop jobs on a cluster whose jobtracker and file system are on a machine in my network called mycluster. conf.set("fs.default.name","hdfs://mycluster:9000"); &nbs...
|
|
|
Author: Steve Lewis,
2012-12-06, 19:35
|
|
|
Re: How do find the version of Hadoop inside a running Map or reduce task - MapReduce - [mail # user]
|
|
...Thanks - that works perfectly The following code reports the version as a counter under "Performance" // sneaky trick to extract the version &n...
|
|
|
Author: Steve Lewis,
2012-11-05, 21:51
|
|
|
How do find the version of Hadoop inside a running Map or reduce task - MapReduce - [mail # user]
|
|
...I need to determine what version of Hadoop is running - say under AWS - I really want to use an API or properties in the running code but do not know how - any ideas Steven M. Lewis Ph...
|
|
|
Author: Steve Lewis,
2012-11-05, 20:54
|
|
|
|
