Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 31 to 40 from 76 (0.101s).
Loading phrases to help you
refine your search...
What is the cost of using a counter - MapReduce - [mail # user]
...I have several counters that I maintain to allow me to keep statistics on critical operations. I have my code incrementing the counters in an inner loop partly to make sure my job is not kil...
   Author: Steve Lewis, 2011-12-08, 18:48
How can a Hadoop program determine it is running in stand alone mode - MapReduce - [mail # user]
...I have some test code that would kill performance (and not work properly on a cluster but can accumulate test data in stand alone mode. I want a way to programatically when the code is runni...
   Author: Steve Lewis, 2011-12-02, 00:10
Gratuitous use of CHMOD in windows - MapReduce - [mail # user]
...I am running a job on a cluster launching from a windows box and " fs.default.name" to point the job to the cluster. Everything works until the last step where I say  FileSystem fileSys...
   Author: Steve Lewis, 2011-11-21, 23:47
Any way to limit the total tasks running on a node in 0.202 - MapReduce - [mail # user]
...Hadoop can set the maximum mappers and reducers running on a node but under 0.20.2 I do not see a way to limit the system from running mappers and reducers together with the total exceeding ...
   Author: Steve Lewis, 2011-11-10, 03:06
[expand - 2 more] - Re: Map Rask has IO exception - MapReduce - [mail # user]
...I suspect that HDFS and/or its local disk may be full or sick  The problem occurs after a job has been running at least 10 hours - I am too new at this to know too much about where to l...
   Author: Steve Lewis, 2011-11-07, 20:03
[expand - 1 more] - Re: Problems with MR Job running really slowly - MapReduce - [mail # user]
...1)  I am varying both the number of mappers and reducers trying to determine three things      a) What are the options I need reducers and mappers to      ...
   Author: Steve Lewis, 2011-11-07, 05:13
[expand - 1 more] - Re: How do I diagnose a really slow copy - MapReduce - [mail # user]
...The task has been running several hours and the map phase is essentially a null mapper - rewrite the key and value stored by an earlier reducer. There is no firewall - the entire job is runn...
   Author: Steve Lewis, 2011-11-04, 19:26
[expand - 1 more] - Re: Is there any way for a single map job to show progress - MapReduce - [mail # user]
...So how does a custom reader to that???  On Thu, Nov 3, 2011 at 10:28 AM,  wrote:    Steven M. Lewis PhD 4221 105th Ave NE Kirkland, WA 98033 206-384-1340 (cell) Skype lor...
   Author: Steve Lewis, 2011-11-03, 18:02
Error reading task outputhttp - MapReduce - [mail # user]
...I think my hdfs may be sick but when I run jobs on out 8 node cluster I have started seeing  11/10/26 15:42:30 WARN mapred.JobClient: Error reading task outputhttp:// glados6.systemsbio...
   Author: Steve Lewis, 2011-10-26, 22:53
Has anyone written a program to show total use on hdfs by directory - MapReduce - [mail # user]
...While I can see file sizes with the web interface, it is very difficult to tell which directories are taking up space especially when nested by several levels  Steven M. Lewis PhD 4221 ...
   Author: Steve Lewis, 2011-10-26, 00:51
MapReduce (74)
Hadoop (38)
Spark (24)
HDFS (5)
mail # user (76)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (76)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (308)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (166)
Jason Lowe (163)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (80)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
Steve Lewis