Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 91 to 100 from 1250 (0.096s).
Loading phrases to help you
refine your search...
Re: performance of "hadoop fs -put" - Hadoop - [mail # user]
...Are you calling one command per file? That's bound to be slow as it invokesa new JVM each time.On Jan 29, 2014 7:15 AM, "Jay Vyas"  wrote: ...
   Author: Harsh J, 2014-01-29, 02:22
Re: memory management module of Namenode - Hadoop - [mail # user]
...Hi,The central class is FSNamesystem.java downwards. I'd advise drillingdown from the NameNodeRpcServer sources athttps://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoo...
   Author: Harsh J, 2014-01-28, 11:01
Re: BlockMissingException reading HDFS file, but the block exists and fsck shows OK - Hadoop - [mail # user]
...Can you check the log of the DN that is holding the specific block for anyerrors?On Jan 27, 2014 8:37 PM, "John Lilley"  wrote: ...
   Author: Harsh J, 2014-01-27, 15:26
Re: HDFS open file limit - Hadoop - [mail # user]
...Hi John,There is a concurrent connections limit on the DNs that's set to a defaultof 4k max parallel threaded connections for reading or writing blocks. Thisis also expandable via configurat...
   Author: Harsh J, 2014-01-27, 15:12
Re: Memory problems with BytesWritable and huge binary files - Hadoop - [mail # user]
...Hi,The Writable interface is not necessary - you can interact with a fileat the input stream level by eliminating it, which is what Vinod wassuggesting in his reply. Checkout the serialisati...
   Author: Harsh J, 2014-01-25, 10:44
Re: HDFS data transfer is faster than SCP based transfer? - Hadoop - [mail # user]
...There's a lot of difference here, although both do use TCP underneath,but do note that SCP securely encrypts data but stock HDFSconfiguration does not.You can also ask SCP to compress data t...
   Author: Harsh J, 2014-01-25, 10:40
Re: Datanode Shutting down automatically - Hadoop - [mail # user]
...You reformatted your NameNode at some point, but likely failed to alsoclear out the DN data directories, which would not auto-wipethemselves.Clear the contents of /app/hadoop/tmp/dfs/data at...
   Author: Harsh J, 2014-01-25, 06:45
Re: What is the fix for this error ? - Hadoop - [mail # user]
...Note that its not an compile error, but a warning.You need to use the getInstance(…) method instead:http://hadoop.apache.org/docs/stable2/api/org/apache/hadoop/mapreduce/Job.html#getInstance...
   Author: Harsh J, 2014-01-25, 02:57
[expand - 2 more] - Re: hdfs fsck -locations - Hadoop - [mail # user]
...The right syntax is to use "-files -blocks -locations", so it drillsdown all the way. You are not "missing" a feature - this has existedfor as long as I've known HDFS.In Rodrigo's output, he...
   Author: Harsh J, 2014-01-25, 01:49
Re: org.apache.hadoop.ipc.StandbyException occurs at the thirty of per hour in standby NN - Hadoop - [mail # user]
...Hi Francis,This is a non-worry, but you're basically hittinghttps://issues.apache.org/jira/browse/HDFS-3447. A temporaryworkaround could be to disable the UGI at the logging configurationlev...
   Author: Harsh J, 2014-01-24, 10:32
Sort:
project
Hadoop (1220)
MapReduce (907)
HDFS (408)
HBase (232)
Avro (86)
Pig (29)
Hive (22)
Bigtop (12)
YARN (11)
Flume (7)
Zookeeper (7)
Impala (3)
Sqoop (2)
type
mail # user (975)
mail # dev (151)
mail # general (68)
issue (56)
date
last 7 days (0)
last 30 days (2)
last 90 days (6)
last 6 months (31)
last 9 months (1250)
author
Harsh J (559)
Owen O'Malley (394)
Steve Loughran (394)
Todd Lipcon (237)
Eli Collins (182)
Alejandro Abdelnur (179)
Arun C Murthy (164)
Allen Wittenauer (152)
Chris Nauroth (150)
Ted Yu (134)
Tom White (121)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Doug Cutting (96)
Colin Patrick McCabe (95)
Aaron Kimball (94)
Edward Capriolo (87)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (71)
Andrew Wang (66)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB