Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 16 (0.071s).
Loading phrases to help you
refine your search...
[expand - 2 more] - Re: Hadoop distcp from CDH4 to Amazon S3 - Improve Throughput - HDFS - [mail # user]
...CDH4 can be either 1.x or2.x hadoop, are you using the 2.x line? I've used it primarily with 1.0.3, which is what AWS uses, so I presume that's what it's tested on.  Himanish Kushary &n...
   Author: David Parks, 2013-03-29, 14:34
Which hadoop installation should I use on ubuntu server? - HDFS - [mail # user]
...I'm moving off AWS MapReduce to our own cluster, I'm installing Hadoop on Ubuntu Server 12.10.     I see a .deb installer and installed that, but it seems like files are all over t...
   Author: David Parks, 2013-03-28, 06:07
For a new installation: use the BackupNode or the CheckPointNode? - HDFS - [mail # user]
...For a new installation of the current stable build (1.1.2 ), is there any reason to use the CheckPointNode over the BackupNode?      It seems that we need to choose one or the...
   Author: David Parks, 2013-03-23, 06:59
[expand - 1 more] - RE: On a small cluster can we double up namenode/master with tasktrackers? - HDFS - [mail # user]
...Good points all,     The mapreduce jobs are, well. intensive. We've got a whole variety, but typically I see them use a lot of CPU, a lot of Disk, and upon occasion a whole bunch o...
   Author: David Parks, 2013-03-20, 09:27
How "Alpha" is "alpha"? - HDFS - [mail # user]
...   "This release, like previous releases in hadoop-2.x series is still considered alpha primarily since some of APIs aren't fully-baked and we expect some churn in future."   ...
   Author: David Parks, 2013-03-12, 07:56
[expand - 1 more] - RE: How can I limit reducers to one-per-node? - HDFS - [mail # user]
...I tried that approach at first, one domain to one reducer, but it failed me because my data set has many domains with just a few thousand images, trivial, but we also have reasonably many ma...
   Author: David Parks, 2013-02-11, 06:29
RE: Question related to Decompressor interface - HDFS - [mail # user]
...In the EncryptedWritableWrapper idea you would create an object that takes any Writable object as it's parameter.      Your EncryptedWritableWrapper would naturally implement ...
   Author: David Parks, 2013-02-11, 03:24
RE: Skipping entire task - HDFS - [mail # user]
...Thinking here... if you submitted the task programmatically you should be able to capture the failure of the task and gracefully move past it to your next tasks.  To say it in a long-wi...
   Author: David Parks, 2013-01-05, 14:14
RE: What does mapred.map.tasksperslot do? - HDFS - [mail # user]
...Ah this is on AWS EMR, hadoop 1.0.3. This could be an AWS feature based on my reading of the AWS docs, but I thought it was hadoop.           From: Hemanth Yamijala ...
   Author: David Parks, 2012-12-27, 09:42
RE: How to submit Tool jobs programatically in parallel? - HDFS - [mail # user]
...Can I do that with s3distcp / distcp?  The job is being configured in the run() method of s3distcp (as it implements Tool).  So I think I can't use this approach. I use this for th...
   Author: David Parks, 2012-12-14, 06:14
MapReduce (21)
Hadoop (14)
HDFS (11)
Pig (3)
HBase (1)
mail # user (16)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (16)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (240)
Tsz Wo (203)
Jing Zhao (174)
Chris Nauroth (166)
Arpit Agarwal (152)
Andrew Wang (143)
Aaron T. Myers (141)
Suresh Srinivas (138)
Brandon Li (137)
Haohui Mai (137)
Kihwal Lee (114)
Daryn Sharp (105)
Ted Yu (83)
Uma Maheswara Rao G (82)
Alejandro Abdelnur (73)
Konstantin Shvachko (63)
Tsz Wo Nicholas Sze (63)
Akira AJISAKA (61)
Stephen Chu (58)
Yongjun Zhang (57)
Steve Loughran (52)
Allen Wittenauer (48)
David Parks