Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 21 to 30 from 37 (0.108s).
Loading phrases to help you
refine your search...
Re: InputSplit is confusing me .. Any clarifications ?? - Hadoop - [mail # user]
...override *TextInputFormat and have *protected boolean *isSplitable*( FileSystem  fs,                             &n...
   Author: Steve Lewis, 2010-11-28, 19:30
[expand - 2 more] - Re: Caution using Hadoop 0.21 - Hadoop - [mail # user]
...Two reasons - 1) we want a unit test to log whenever a write occurs 2) I want the keys generated by a write in a subsection of the app  to be augmented by added data before being sent t...
   Author: Steve Lewis, 2010-11-16, 17:31
[expand - 2 more] - Re: 0.21 found interface but class was expected - Hadoop - [mail # user]
...Java libraries are VERY reluctant to change major classes in a way that breaks backward compatability - NOTE that while the 0.18 packages are  deprecated, they are separate from the 0.2...
   Author: Steve Lewis, 2010-11-13, 23:22
Running as multiple users on a cluster - Hadoop - [mail # user]
...We have recently set up a hadoop 0.21 cluster. It looks as if jobs are designed to run as a user www  We would like to run jobs as individual users - say joe, bill, sue  This raise...
   Author: Steve Lewis, 2010-11-10, 21:19
Permissions issue - Hadoop - [mail # user]
...Using a copy of the Cloudera  security-enabled CDH3b3, we installed vanilla hadoop in /home/www/hadoop  Now when a try to run a job as me I get permission errors - I am not even su...
   Author: Steve Lewis, 2010-11-09, 21:29
Is there a way to use the Cloudera Distribution without root access - Hadoop - [mail # user]
...We are trying set up a cluster using the latest Cloudera distribution. The issue is that IT will not give us root access to the systems in the cluster. The people trying to set up the cluste...
   Author: Steve Lewis, 2010-11-09, 00:20
Is there any reliable way for a reducer to determine the number of mappers used in a job - Hadoop - [mail # user]
...Short of having every mapper increment a counter  Steven M. Lewis PhD 4221 105th Ave Ne Kirkland, WA 98033 206-384-1340 (cell) Institute for Systems Biology Seattle WA...
   Author: Steve Lewis, 2010-11-04, 20:28
Is there an any way to change the number of reduce jobs on a local hadoop job - Hadoop - [mail # user]
...I frequently run small versions of my Hadoop jobs as local single machine jobs to debug my logic. When I do this I always get only a single reduce task even when I call setNumReduceTasks wit...
   Author: Steve Lewis, 2010-10-29, 18:10
Statistics and Early Keys to Reducers - Hadoop - [mail # user]
...Imaging I have the following problem - I want to call a standard word count program but instead of having the reducer output the word and its count I want it to output the word and the count...
   Author: Steve Lewis, 2010-10-28, 15:53
[expand - 1 more] - Re: Approached to combing the output of reducers - Hadoop - [mail # user]
...will assign the output intended for a single file to a single reducer (in some cases multiple output files might be supported - one per reducer - On issue is how to allow the reducer to writ...
   Author: Steve Lewis, 2010-10-23, 23:19
MapReduce (74)
Hadoop (37)
Spark (22)
HDFS (5)
mail # user (37)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (37)
Harsh J (559)
Owen O'Malley (394)
Steve Loughran (390)
Todd Lipcon (238)
Eli Collins (182)
Alejandro Abdelnur (178)
Arun C Murthy (163)
Allen Wittenauer (148)
Chris Nauroth (146)
Ted Yu (126)
Tom White (121)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Doug Cutting (96)
Aaron Kimball (94)
Colin Patrick McCabe (93)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (70)
Suresh Srinivas (64)
Steve Lewis