Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 81 to 90 from 1239 (0.112s).
Loading phrases to help you
refine your search...
Re: HDFS open file limit - Hadoop - [mail # user]
...Hi John,There is a concurrent connections limit on the DNs that's set to a defaultof 4k max parallel threaded connections for reading or writing blocks. Thisis also expandable via configurat...
   Author: Harsh J, 2014-01-27, 15:12
Re: Memory problems with BytesWritable and huge binary files - Hadoop - [mail # user]
...Hi,The Writable interface is not necessary - you can interact with a fileat the input stream level by eliminating it, which is what Vinod wassuggesting in his reply. Checkout the serialisati...
   Author: Harsh J, 2014-01-25, 10:44
Re: HDFS data transfer is faster than SCP based transfer? - Hadoop - [mail # user]
...There's a lot of difference here, although both do use TCP underneath,but do note that SCP securely encrypts data but stock HDFSconfiguration does not.You can also ask SCP to compress data t...
   Author: Harsh J, 2014-01-25, 10:40
Re: Datanode Shutting down automatically - Hadoop - [mail # user]
...You reformatted your NameNode at some point, but likely failed to alsoclear out the DN data directories, which would not auto-wipethemselves.Clear the contents of /app/hadoop/tmp/dfs/data at...
   Author: Harsh J, 2014-01-25, 06:45
Re: What is the fix for this error ? - Hadoop - [mail # user]
...Note that its not an compile error, but a warning.You need to use the getInstance(…) method instead:http://hadoop.apache.org/docs/stable2/api/org/apache/hadoop/mapreduce/Job.html#getInstance...
   Author: Harsh J, 2014-01-25, 02:57
Re: hdfs fsck -locations - Hadoop - [mail # user]
...The right syntax is to use "-files -blocks -locations", so it drillsdown all the way. You are not "missing" a feature - this has existedfor as long as I've known HDFS.In Rodrigo's output, he...
[+ more]    Author: Harsh J, 2014-01-25, 01:49
Re: org.apache.hadoop.ipc.StandbyException occurs at the thirty of per hour in standby NN - Hadoop - [mail # user]
...Hi Francis,This is a non-worry, but you're basically hittinghttps://issues.apache.org/jira/browse/HDFS-3447. A temporaryworkaround could be to disable the UGI at the logging configurationlev...
   Author: Harsh J, 2014-01-24, 10:32
Re: How to learn hadoop follow Tom White - Hadoop - [mail # user]
...The book's contents should still be very relevant as the APIs haven't changed.  On Wed, Jan 22, 2014 at 11:23 AM, Cooleaf  wrote:    Harsh J...
   Author: Harsh J, 2014-01-22, 06:28
Re: How to configure multiple reduce jobs in hadoop 2.2.0 - Hadoop - [mail # user]
...Yes, you need to manually set it. Please see the API at http://hadoop.apache.org/docs/stable2/api/org/apache/hadoop/mapred/JobConf.html#setNumReduceTasks(int)  On Thu, Jan 16, 2014 at 1...
   Author: Harsh J, 2014-01-16, 07:40
Re: org.apache.hadoop.hdfs.server.protocol.DisallowedDatanodeExceptio - Hadoop - [mail # user]
...Your hdfs-site.xml on the NN defines an "includes" file, but the includes file does not list this connecting DN's proper hostname/IP, causing the NN to reject it when it tries to ask itself ...
   Author: Harsh J, 2014-01-09, 11:26
Hadoop (1209)
MapReduce (908)
HDFS (407)
HBase (232)
Avro (84)
Pig (29)
Hive (22)
Bigtop (12)
YARN (10)
Flume (7)
Zookeeper (7)
Sqoop (2)
Impala (1)
mail # user (963)
mail # dev (152)
mail # general (68)
issue (56)
last 7 days (5)
last 30 days (8)
last 90 days (27)
last 6 months (75)
last 9 months (1239)
Harsh J (554)
Owen O'Malley (394)
Steve Loughran (382)
Todd Lipcon (238)
Eli Collins (182)
Alejandro Abdelnur (164)
Arun C Murthy (162)
Chris Nauroth (142)
Allen Wittenauer (128)
Tom White (121)
Ted Yu (118)
Nigel Daley (115)
Daryn Sharp (110)
Konstantin Shvachko (107)
Doug Cutting (96)
Aaron Kimball (94)
Edward Capriolo (87)
Colin Patrick McCabe (86)
Mark Kerzner (86)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (69)
Suresh Srinivas (65)