Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 111 to 120 from 173 (0.108s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Backup NameNode metadata in HA configuration - Hadoop - [mail # general]
...Hi,You'll ideally just need the latestfsimage file, which includes the whole check pointed namespace, so"hdfs dfsadmin -fetch" is appropriate.On Tue, Feb 4, 2014 at 3:02 AM, Ivan Tretyakov&n...
   Author: Harsh J, 2014-02-04, 02:01
Re: Capture Directory Context in Hadoop Mapper - Hadoop - [mail # general]
...Hi,These posts are nicely written - thanks for sharing! Have you alsotaken a look at the MultipleInputs feature, which gives you a cleanerapproach? http://hadoop.apache.org/docs/stable2/api/...
   Author: Harsh J, 2014-01-30, 06:16
Re: Configuring hadoop 2.2.0 - Hadoop - [mail # general]
...I don't believe what you've been told is correct (IIUC). HDFS is anindependent component and does not require presence of YARN (or MR) tofunction correctly.What do you exactly mean when you ...
   Author: Harsh J, 2014-01-29, 10:09
[expand - 1 more] - Re: Force one mapper per machine (not core)? - Hadoop - [mail # general]
...Is your cluster running MR1 or MR2? On MR1, the CapacitySchedulerwould allow you to do this if you used appropriate memory basedrequests (see http://search-hadoop.com/m/gnFs91yIg1e), and on ...
   Author: Harsh J, 2014-01-29, 08:53
Re: performance of "hadoop fs -put" - Hadoop - [mail # user]
...Are you calling one command per file? That's bound to be slow as it invokesa new JVM each time.On Jan 29, 2014 7:15 AM, "Jay Vyas"  wrote: ...
   Author: Harsh J, 2014-01-29, 02:22
Re: memory management module of Namenode - Hadoop - [mail # user]
...Hi,The central class is FSNamesystem.java downwards. I'd advise drillingdown from the NameNodeRpcServer sources athttps://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoo...
   Author: Harsh J, 2014-01-28, 11:01
Re: BlockMissingException reading HDFS file, but the block exists and fsck shows OK - Hadoop - [mail # user]
...Can you check the log of the DN that is holding the specific block for anyerrors?On Jan 27, 2014 8:37 PM, "John Lilley"  wrote: ...
   Author: Harsh J, 2014-01-27, 15:26
Re: HDFS open file limit - Hadoop - [mail # user]
...Hi John,There is a concurrent connections limit on the DNs that's set to a defaultof 4k max parallel threaded connections for reading or writing blocks. Thisis also expandable via configurat...
   Author: Harsh J, 2014-01-27, 15:12
Re: Memory problems with BytesWritable and huge binary files - Hadoop - [mail # user]
...Hi,The Writable interface is not necessary - you can interact with a fileat the input stream level by eliminating it, which is what Vinod wassuggesting in his reply. Checkout the serialisati...
   Author: Harsh J, 2014-01-25, 10:44
Re: HDFS data transfer is faster than SCP based transfer? - Hadoop - [mail # user]
...There's a lot of difference here, although both do use TCP underneath,but do note that SCP securely encrypts data but stock HDFSconfiguration does not.You can also ask SCP to compress data t...
   Author: Harsh J, 2014-01-25, 10:40
Sort:
project
Hadoop (173)
MapReduce (72)
HDFS (55)
HBase (34)
Avro (29)
Hive (13)
YARN (13)
Bigtop (10)
Impala (7)
Pig (5)
Sqoop (3)
Flume (1)
Zookeeper (1)
type
mail # user (95)
issue (60)
mail # dev (10)
mail # general (8)
date
last 7 days (0)
last 30 days (0)
last 90 days (9)
last 6 months (21)
last 9 months (173)
author
Owen O'Malley (250)
Steve Loughran (199)
Allen Wittenauer (171)
Chris Nauroth (163)
Alejandro Abdelnur (140)
Todd Lipcon (123)
Daryn Sharp (114)
Colin Patrick McCabe (112)
Eli Collins (111)
Kai Zheng (92)
Konstantin Shvachko (88)
Nigel Daley (80)
Arun C Murthy (75)
Akira AJISAKA (71)
Hairong Kuang (71)
Benoy Antony (70)
Harsh J (69)
Runping Qi (67)
Ted Yu (66)
Karthik Kambatla (64)
Andrew Wang (61)
Haohui Mai (61)
dhruba borthakur (61)
Doug Cutting (59)
Arpit Agarwal (58)
Ivan Mitic (58)
Tom White (55)
Devaraj Das (50)
Yi Liu (50)
Kihwal Lee (46)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB