| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
99 (4.178s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Problems Mapping multigigabyte file - MapReduce - [mail # user]
|
|
...I have an MR task which runs well with a single input file or an input directory with dozens of 50MB input files. When the data is in a single input file of 1 GB of more the mapper nev...
|
|
|
Author: Steve Lewis,
2011-10-14, 15:23
|
|
|
Problems talking to the cluster over VPN - MapReduce - [mail # user]
|
|
...I have code to talk to a remote cluster where host = "myhost:" and port 9000 String connectString = "hdfs://" + host + ":" + port + "/"; ...
|
|
|
Author: Steve Lewis,
2011-10-06, 21:19
|
|
|
Tasks running out of memory and mapred.child.ulimit - MapReduce - [mail # user]
|
|
...I have a small hadoop task which is running out of memory on a colleague's cluster. I looked at has mapred-site.xml and find mapred.child.java.opts ...
|
|
|
Author: Steve Lewis,
2011-09-30, 17:23
|
|
|
Re: Execution directory for child process within mapper - MapReduce - [mail # user]
|
|
...I had a similar issue - when I needed the same file for each reduce (or map task) I simply added Java code to the setup method to write a file to ".". When every map needed different files I...
|
|
|
Author: Steve Lewis,
2011-09-26, 19:27
|
|
|
Reading the value of a counter - MapReduce - [mail # user]
|
|
...Assume I have a class which extends Configured implements Tool Assume I run the job using the run method. Within my job I increment a counter. When I finish the run I want the fi...
|
|
|
Author: Steve Lewis,
2011-09-26, 19:17
|
|
|
Any good gui tools for working with hdfs - MapReduce - [mail # user]
|
|
...My dfs is a real mess and I am looking for a good gui fiile manager to allow me to clean it up deleting a lot of directories Anyone written one??? Steven M. Lewis PhD 4221 105th Ave NE Kirkl...
|
|
|
Author: Steve Lewis,
2011-09-20, 22:50
|
|
|
Re: Has anyone ever written a file system where the data is held in resources - MapReduce - [mail # user]
|
|
...No - the issue is I want is I want Hadoop to read resources as input files as if they were in hdfs - I know how to read resources as input streams but I don't know how to get a Hadoop file s...
|
|
|
Author: Steve Lewis,
2011-09-14, 16:47
|
|
|
Has anyone ever written a file system where the data is held in resources - MapReduce - [mail # user]
|
|
...When writing tests it is useful to keep all data in resources since this makes automatic execution easier. The structure of a set of resources should make it easy to have a schema such as re...
|
|
|
Author: Steve Lewis,
2011-09-14, 16:24
|
|
|
Re: Does anyone have sample code for forcing a custom InputFormat to use a small split - MapReduce - [mail # user]
|
|
...Thanks - what NLineInputFormat is pretty close to what I want. In most cases the file is text and quite splittable although it raises another issue - sometimes the file is compressed -...
|
|
|
Author: Steve Lewis,
2011-09-13, 01:11
|
|
|
Does anyone have sample code for forcing a custom InputFormat to use a small split - MapReduce - [mail # user]
|
|
...I have a problem where there is a single, relatively small (10-20 MB) input file. (It happens it is a fasta file which will have meaning if you are a biologist.) I am already using a c...
|
|
|
Author: Steve Lewis,
2011-09-12, 02:27
|
|
|
|
