Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 41 to 50 from 76 (0.085s).
Loading phrases to help you
refine your search...
Is there a good way to see how full hdfs is - MapReduce - [mail # user]
...We have a small cluster with HDFS running on only 8 nodes - I believe that the partition assigned to hdfs might be getting full and wonder if the web tools or java api havew a way to look at...
   Author: Steve Lewis, 2011-10-15, 00:16
[expand - 1 more] - Re: Problems Mapping multigigabyte file - MapReduce - [mail # user]
...Yes and I  presume that both the cases that succeed and fail are being split  On Fri, Oct 14, 2011 at 8:49 AM, Justin Woody wrote:     Steven M. Lewis PhD 4221 105th Ave ...
   Author: Steve Lewis, 2011-10-14, 16:03
Problems talking to the cluster over VPN - MapReduce - [mail # user]
...I have code to talk to a remote cluster where host = "myhost:" and port  9000         String connectString =   "hdfs://" + host + ":" + port + "/";    ...
   Author: Steve Lewis, 2011-10-06, 21:19
Tasks running out of memory and mapred.child.ulimit - MapReduce - [mail # user]
...I have a small hadoop task which is running out of memory on a colleague's cluster. I looked at has mapred-site.xml and find         mapred.child.java.opts     ...
   Author: Steve Lewis, 2011-09-30, 17:23
Re: Execution directory for child process within mapper - MapReduce - [mail # user]
...I had a similar issue - when I needed the same file for each reduce (or map task) I simply added Java code to the setup method to write a file to ".". When every map needed different files I...
   Author: Steve Lewis, 2011-09-26, 19:27
Reading the value of a counter - MapReduce - [mail # user]
...Assume I have a class which extends Configured implements Tool  Assume I run the job using the run method.  Within my job I increment a counter. When I finish the run I want the fi...
   Author: Steve Lewis, 2011-09-26, 19:17
Any good gui tools for working with hdfs - MapReduce - [mail # user]
...My dfs is a real mess and I am looking for a good gui fiile manager to allow me to clean it up deleting a lot of directories Anyone written one??? Steven M. Lewis PhD 4221 105th Ave NE Kirkl...
   Author: Steve Lewis, 2011-09-20, 22:50
[expand - 1 more] - Re: Has anyone ever written a file system where the data is held in resources - MapReduce - [mail # user]
...No - the issue is I want is I want Hadoop to read resources as input files as if they were in hdfs - I know how to read resources as input streams but I don't know how to get a Hadoop file s...
   Author: Steve Lewis, 2011-09-14, 16:47
[expand - 1 more] - Re: Does anyone have sample code for forcing a custom InputFormat to use a small split - MapReduce - [mail # user]
...Thanks - what NLineInputFormat is pretty close to what I want. In most cases the file is text and quite splittable  although it raises another issue - sometimes the file is compressed -...
   Author: Steve Lewis, 2011-09-13, 01:11
[expand - 3 more] - Re: How would you translate this into MapReduce? - MapReduce - [mail # user]
...If the size of a record is too big to be processed by a node you probably need to re-architect using a different record which scales better and combines cleanly You also need to ask at the s...
   Author: Steve Lewis, 2011-07-19, 19:40
MapReduce (74)
Hadoop (37)
Spark (12)
HDFS (5)
mail # user (76)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (76)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (165)
Jason Lowe (161)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (78)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
Steve Lewis