Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 41 to 50 from 50 (0.084s).
Loading phrases to help you
refine your search...
Re: no output written to HDFS - Hadoop - [mail # user]
...Do you observe the same thing when running without Hadoop? (cat, map, sort and then reduce)  Could you provide the counters of your job? You should be able to get them using the job tra...
   Author: Bertrand Dechoux, 2012-08-30, 05:45
Re: Measuring Shuffle time for MR job - Hadoop - [mail # user]
...Shuffle time is considered as part of the reduce step. Without reduce, there is no need for shuffling. One way to measure it would be using the full reduce time with a '/dev/null' reducer. &...
   Author: Bertrand Dechoux, 2012-08-27, 07:57
Re: doubt about reduce tasks and block writes - Hadoop - [mail # user]
...Assuming that node A only contains replica, there is no garante that its data would never be read. First, you might lose a replica. The copy inside the node A could be used to create the mis...
   Author: Bertrand Dechoux, 2012-08-24, 22:02
Re: Question Regarding FileAlreadyExistsException - Hadoop - [mail # user]
...I don't think so. The client is responsible for deleting the resource before, if it might exist. Correct me if I am wrong.  Higher solution (such as Cascading) usually provides a way to...
   Author: Bertrand Dechoux, 2012-08-23, 13:28
[expand - 1 more] - Re: Number of Maps running more than expected - Hadoop - [mail # user]
...Also could you tell us more about your task statuses? You might also have failed tasks...   Bertrand  On Thu, Aug 16, 2012 at 11:01 PM, Bertrand Dechoux wrot e:  s w of em t e...
   Author: Bertrand Dechoux, 2012-08-16, 21:35
Re: help in distribution of a task with hadoop - Hadoop - [mail # user]
...1) A standard way of doing it would be to have all your files content inside HDFS. You could then process  where key would be the name of the file and value its contents. It would impro...
   Author: Bertrand Dechoux, 2012-08-13, 18:22
Re: Mechanism of hadoop -jar - Hadoop - [mail # user]
...1) Source code for sure. I don't know if you could find any other technical document about it.  2) Where is your file? If it is inside your jar, hadoop should not infer with the 'normal...
   Author: Bertrand Dechoux, 2012-08-11, 22:47
Re: Reducer MapFileOutpuFormat - Hadoop - [mail # user]
...Your use of 'index' is indeed not clear. Are you talking about Hive or HBase?  I can confirm that you will have one result file per reducer. Of course, for efficiency reasons, you need ...
   Author: Bertrand Dechoux, 2012-07-27, 05:54
Re: Hadoop Multithread MapReduce - Hadoop - [mail # user]
...Hi,  Summarizing the two previous answers : yes, multithreaded mappers are supported. However, the most common use case is to increase the number of map 'slots'.  Have you consider...
   Author: Bertrand Dechoux, 2012-07-26, 07:19
Re: Implement Triggers for HDFS - Hadoop - [mail # user]
...HBase has coprocessors which might help you with your use case.  https://blogs.apache.org/hbase/entry/coprocessor_introduction  Regards  Bertrand  On Thu, Jul 26, 2012 at...
   Author: Bertrand Dechoux, 2012-07-26, 07:03
Sort:
project
MapReduce (62)
Hadoop (49)
Hive (27)
HDFS (12)
Spark (12)
Avro (11)
Flume (9)
Pig (7)
HBase (4)
type
mail # user (47)
issue (3)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (12)
last 9 months (50)
author
Harsh J (560)
Steve Loughran (405)
Owen O'Malley (394)
Todd Lipcon (237)
Eli Collins (182)
Alejandro Abdelnur (179)
Arun C Murthy (166)
Allen Wittenauer (161)
Chris Nauroth (156)
Ted Yu (140)
Tom White (120)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Colin Patrick McCabe (101)
Doug Cutting (96)
Aaron Kimball (94)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Benoy Antony (72)
Konstantin Boudnik (72)
Runping Qi (72)
Karthik Kambatla (68)
Bertrand Dechoux
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB