Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 31 to 40 from 437 (0.116s).
Loading phrases to help you
refine your search...
Re: manage bandwidth resource in YARN - HDFS - [mail # user]
...Do you speak of the MR ShuffleHandler or something just more generic?  I am not aware of such a feature or a JIRA for it yet. We do have support for CPU/Memory resource management, but ...
   Author: Harsh J, 2013-09-05, 03:04
[expand - 1 more] - Re: custom writablecomparable with complex fields - HDFS - [mail # user]
...The easy way is to deserialize each stream into objects, then compare them, pretty much what most of the defaults do.  Comparing without deserializing the whole stream is much faster an...
   Author: Harsh J, 2013-09-01, 16:18
Re: How to change default ports of datanodes in a cluster - HDFS - [mail # user]
...Looking at the hdfs-default.xml should help with such questions: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml  The property you need is dfs.dat...
   Author: Harsh J, 2013-08-31, 16:14
Re: InvalidProtocolBufferException while submitting crunch job to cluster - HDFS - [mail # user]
...Your cluster is using HDFS HA, and therefore requires a little more configs than just fs.defaultFS/etc..  You need to use the right set of cluster client configs. If you don't have them...
   Author: Harsh J, 2013-08-31, 16:12
Re: Hadoop client user - HDFS - [mail # user]
...The user1 will mainly require a home directory on the HDFS, created by the HDFS administrator user ('hadoop' in your case): sudo -u hadoop hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop...
   Author: Harsh J, 2013-08-29, 05:25
Re: There are 2 datanode(s) running and 2 node(s) are excluded in this operation. - HDFS - [mail # user]
...The client side exclusion has nothing to do with dfs.hosts.exclude. Its more than likely that the distcp command is unable to query one of the HDFS' clusters' DNs, and is therefore excluding...
   Author: Harsh J, 2013-08-28, 10:26
Re: Namenode joining error in HA configuration - HDFS - [mail # user]
...Thanks. I don't believe we support Solaris 10 (i.e. we do not intensively test over it), but what that piece behind the failure does is execute "bash -c exec 'df -k /namedirpath'". If such a...
   Author: Harsh J, 2013-08-28, 08:37
Re: Create a file in local file system in map method - HDFS - [mail # user]
...Can you share what error you run into in trying to write to a local filesystem location from within a map task?  Note that the map tasks will run as the same user as the TaskTracker dae...
   Author: Harsh J, 2013-08-22, 10:18
Re: about append - HDFS - [mail # user]
...Append implementation in 1.x was the first take, and was found to carry a few important issues, for which it therefore received a newer implementation in what's now 0.23.x/2.x. Read https://...
   Author: Harsh J, 2013-08-20, 17:13
Re: when Standby Namenode is doing checkpoint, the Active NameNode is slow. - HDFS - [mail # user]
...Perhaps turning on fsimage compression may help. See documentation of dfs.image.compress at http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml.  You ...
   Author: Harsh J, 2013-08-13, 10:36
Sort:
project
Hadoop (1223)
MapReduce (909)
HDFS (410)
HBase (232)
Avro (86)
Pig (29)
Hive (22)
Bigtop (12)
YARN (12)
Flume (7)
Zookeeper (7)
Impala (4)
Sqoop (2)
type
mail # user (338)
issue (52)
mail # dev (47)
date
last 7 days (2)
last 30 days (3)
last 90 days (5)
last 6 months (7)
last 9 months (437)
author
Todd Lipcon (326)
Harsh J (264)
Eli Collins (263)
Colin Patrick McCabe (254)
Tsz Wo (201)
Jing Zhao (182)
Haohui Mai (176)
Chris Nauroth (175)
Arpit Agarwal (155)
Andrew Wang (150)
Brandon Li (143)
Aaron T. Myers (142)
Suresh Srinivas (139)
Kihwal Lee (122)
Daryn Sharp (110)
Ted Yu (99)
Uma Maheswara Rao G (87)
Tsz Wo Nicholas Sze (80)
Alejandro Abdelnur (73)
Konstantin Shvachko (68)
Yongjun Zhang (66)
Akira AJISAKA (61)
Stephen Chu (59)
Steve Loughran (57)
Allen Wittenauer (56)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB