Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 51 to 60 from 1253 (0.176s).
Loading phrases to help you
refine your search...
Re: Number of map task - Hadoop - [mail # user]
...Hi,Pig applies a CombineFileInputFormat wrapper on top of the storage bydefault: http://pig.apache.org/docs/r0.12.0/perf.html#combine-filesPlease also ask Pig specific questions on its own l...
   Author: Harsh J, 2014-04-12, 12:40
Re: InputFormat and InputSplit - Network location name contains /: - Hadoop - [mail # user]
...Do not use the InputSplit's getLocations() API to supply your filepath, it is not intended for such things, if thats what you've done inyour current InputFormat implementation.If you're look...
   Author: Harsh J, 2014-04-11, 04:17
Re: not able to run map reduce job example on aws machine - Hadoop - [mail # user]
..."java.lang.IllegalArgumentException: Does not contain a validhost:port authority: poc_hadoop04:46162"Hostnames cannot carry an underscore '_' character per RFC 952 and itsextensions. Please ...
   Author: Harsh J, 2014-04-10, 13:41
Re: Hadoop 2.2.0-cdh5.0.0-beta-1 - MapReduce Streaming - Failed to run on a larger jobs - Hadoop - [mail # user]
...It appears to me that whatever chunk of the input CSV files your maptask 000149 gets, the program is unable to process it and throws anerror and exits.Look into the attempt_1395628276810_006...
   Author: Harsh J, 2014-04-10, 06:32
Re: use setrep change number of file replicas,but not work - Hadoop - [mail # user]
...The replica deletion is asynchronous. You can track its deletions viathe NameNode's over-replicated blocks and the pending delete metrics.On Thu, Apr 10, 2014 at 7:16 AM, ch huang  wrot...
   Author: Harsh J, 2014-04-10, 02:51
Re: File requests to Namenode - Hadoop - [mail # user]
...You could look at metrics the NN publishes, or look at/process theHDFS audit log.On Wed, Apr 9, 2014 at 6:36 PM, Diwakar Sharma  wrote:Harsh J ...
   Author: Harsh J, 2014-04-10, 01:23
Re: MapReduce for complex key/value pairs? - Hadoop - [mail # user]
...Yes, you can write custom writable classes that detail and serialiseyour required data structure. If you have Hadoop: The DefinitiveGuide, checkout its section "Serialization" under chapter ...
   Author: Harsh J, 2014-04-08, 18:31
Re: Hadoop v1.8 data transfer protocol - Hadoop - [mail # dev]
...There's been no Apache Hadoop release versioned v1.8 historically, noris one upcoming. Do you mean 0.18?Either way, can you point to the specific code lines in BlockSenderwhich have you conf...
   Author: Harsh J, 2014-04-07, 02:00
Re: customize containter-log4j.properties - Hadoop - [mail # user]
...This is intentional, and only within MR2's scope - we do not supportconfiguring the formatting, but do support switching the levels (viajob properties). You should still be able to customise...
   Author: Harsh J, 2014-04-05, 17:14
[expand - 1 more] - Re: Why block sizes shown by 'fsck' and '-stat' are inconsistent? - Hadoop - [mail # user]
...The block size is a meta attribute. If you append to the file later,it still needs to know when to split further - so it keeps that valueas a mere metadata it can use to advise itself on wri...
   Author: Harsh J, 2014-04-05, 17:04
Sort:
project
Hadoop (1223)
MapReduce (909)
HDFS (410)
HBase (232)
Avro (86)
Pig (29)
Hive (22)
Bigtop (12)
YARN (12)
Flume (7)
Zookeeper (7)
Impala (4)
Sqoop (2)
type
mail # user (976)
mail # dev (152)
mail # general (68)
issue (57)
date
last 7 days (1)
last 30 days (3)
last 90 days (6)
last 6 months (25)
last 9 months (1253)
author
Harsh J (562)
Steve Loughran (405)
Owen O'Malley (394)
Todd Lipcon (236)
Eli Collins (182)
Alejandro Abdelnur (179)
Arun C Murthy (166)
Allen Wittenauer (161)
Chris Nauroth (156)
Ted Yu (139)
Tom White (121)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Colin Patrick McCabe (101)
Doug Cutting (96)
Aaron Kimball (94)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Benoy Antony (72)
Konstantin Boudnik (72)
Runping Qi (72)
Karthik Kambatla (67)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB