Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 20 from 76 (0.074s).
Loading phrases to help you
refine your search...
Re: How to process only input files containing 100% valid rows - MapReduce - [mail # user]
...With files that small it is much better to write a custom input format which checks the entire file and only passes records from good files. If you need Hadoop you are probably processing a ...
   Author: Steve Lewis, 2013-04-18, 21:50
Re: Querying a Prolog Server from a JVM during a MapReduce Job - MapReduce - [mail # user]
...Assuming that the server can handle high volume and multiple queries there is no reason not to run it on a large and powerful machine outside the cluster. Nothing prevents your mappers from ...
   Author: Steve Lewis, 2013-04-16, 21:01
Re: Java jars and MapReduce - MapReduce - [mail # user]
...A few basic questions - 1) is the rate limiting step the Java processing or storage in accumulo. Hadoop may not be able to speed up a database which is not designed to work in a distributed ...
   Author: Steve Lewis, 2013-03-02, 04:21
What resources are used by idle NameNode and JobTracker tasks - MapReduce - [mail # user]
...I have Hadoop running on 8 nodes in a 50 node cluster. The NameNode and Jobtrackers have been running for months while jobs were run occasionally - usually no more than a dozen a week and mo...
   Author: Steve Lewis, 2013-02-11, 18:07
[expand - 1 more] - Re: Running from a client machine does not work under 1.03 - MapReduce - [mail # user]
...The immediate problem is  an access exception - users like Asterix\Steve - completely unknown to the  file system cannot write files or directories.  There is another error "I...
   Author: Steve Lewis, 2012-12-08, 02:17
File permissions in HDFS - MapReduce - [mail # user]
... I am running Hadoop jobs on a cluster whose jobtracker and file system are on a machine in my network called mycluster.   conf.set("fs.default.name","hdfs://mycluster:9000"); &nbs...
   Author: Steve Lewis, 2012-12-06, 19:35
[expand - 1 more] - Re: How do find the version of Hadoop inside a running Map or reduce task - MapReduce - [mail # user]
...Thanks - that works perfectly  The following code reports the version as a counter under "Performance"        // sneaky trick to extract the version     &n...
   Author: Steve Lewis, 2012-11-05, 21:51
Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue. - MapReduce - [mail # user]
...[We get 'There is insufficient memory for the Java Runtime Environment to continue.' any time we run any job including the most trivial word count process. It is true I am generating a jar f...
   Author: Steve Lewis, 2012-10-05, 09:50
I need help defending the use of Hadoop on a mixed use cluster - MapReduce - [mail # user]
...Another  lab has a cluster with about a thousand nodes. I have been using eight of their nodes for some hadoop development. Recently my group was offered the use of the entire cluster a...
   Author: Steve Lewis, 2012-07-30, 15:32
[expand - 1 more] - Re: Map Reduce Theory Question, getting OutOfMemoryError while reducing - MapReduce - [mail # user]
...Use a custom partitioner and grouping comparator as described here http://pkghosh.wordpress.com/2011/04/13/map-reduce-secondary-sort-does-it-all/  in effect make the time part of the ke...
   Author: Steve Lewis, 2012-06-29, 00:58
MapReduce (74)
Hadoop (37)
Spark (22)
HDFS (5)
mail # user (76)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (76)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (166)
Jason Lowe (162)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (80)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
Steve Lewis