Colin Patrick McCabe
Aaron T. Myers
Tsz Wo Nicholas Sze
Vinod Kumar Vavilapalli
Brahma Reddy Battula
Uma Maheswara Rao G
Arun C Murthy
Tsz Wo Sze
mail # dev
mail # user
last 7 days (0)
last 30 days (1)
last 90 days (2)
last 6 months (5)
last 9 months (535)
newest on top
oldest on top
. Results from
Loading phrases to help you
refine your search...
[HDFS-3528] Use native CRC32 in DFS write path
...HDFS-2080 improved the CPU efficiency of the read path by using native SSE-enabled code for CRC verification. Benchmarks of the write path show that it's often CPU bound by checksums as well...
, 2014-09-05, 10:45
[HDFS-3796] Speed up edit log tests by avoiding fsync()
...Our edit log tests are very slow because they incur a lot of fsyncs as they write out transactions. Since fsync() has no effect except in the case of power outages or system crashes, and we ...
, 2014-09-04, 01:59
[HDFS-3190] Simple refactors in existing NN code to assist QuorumJournalManager extension
...This JIRA is for some simple refactors in the NN: refactor the code which writes the seen_txid file in NNStorage into a new "LongContainingFile" utility class. This is useful for the Journal...
, 2014-09-04, 01:59
[HDFS-3245] Add metrics and web UI for cluster version summary
...With the introduction of protocol compatibility, once HDFS-2983 is committed, we have the possibility that different nodes in a cluster are running different software versions. To aid operat...
, 2014-09-04, 00:49
[HDFS-3626] Creating file with invalid path can corrupt edit log
...Joris Bontje reports the following:The following command results in a corrupt NN editlog (note the double slash and reading from stdin):$ cat /usr/share/dict/words | hadoop fs -put - hdfs://...
, 2014-09-04, 00:21
[HDFS-4182] SecondaryNameNode leaks NameCache entries
...We recently saw an issue where a 2NN ran out of memory, even though it had a relatively small fsimage. When we looked at the heap dump, we saw that all of the memory had gone to entries in t...
, 2014-09-04, 00:19
[HDFS-3875] Issue handling checksum errors in write pipeline
...We saw this issue with one block in a large test cluster. The client is storing the data with replication level 2, and we saw the following: the second node in the pipeline detects a checksu...
, 2014-09-04, 00:00
[HDFS-4128] 2NN gets stuck in inconsistent state if edit log replay fails in the middle
...We saw the following issue in a cluster: The 2NN downloads an edit log segment:2012-10-29 12:30:57,433 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /xxxxxxx/current/edits_000...
, 2014-09-03, 23:55
[HDFS-3529] Use direct buffers for data in write path
...The write path currently makes several unnecessary data copies in order to go to and from byte arrays. We can improve performance by using direct byte buffers to avoid the copy. This is also...
, 2014-09-01, 04:21
[HDFS-4486] Add log category for long-running DFSClient notices
...There are a number of features in the DFS client which are transparent but can make a fairly big difference for performance – two in particular are short circuit reads and native check...
, 2014-08-27, 22:27
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by