metrics + logs =
. Results from
Loading phrases to help you
refine your search...
[HDFS-3528] Use native CRC32 in DFS write path
...HDFS-2080 improved the CPU efficiency of the read path by using native SSE-enabled code for CRC verification. Benchmarks of the write path show that it's often CPU bound by checksums as well...
, 2014-09-05, 10:45
[HDFS-3796] Speed up edit log tests by avoiding fsync()
...Our edit log tests are very slow because they incur a lot of fsyncs as they write out transactions. Since fsync() has no effect except in the case of power outages or system crashes, and we ...
, 2014-09-04, 01:59
[HDFS-3190] Simple refactors in existing NN code to assist QuorumJournalManager extension
...This JIRA is for some simple refactors in the NN: refactor the code which writes the seen_txid file in NNStorage into a new "LongContainingFile" utility class. This is useful for the Journal...
, 2014-09-04, 01:59
[HDFS-3245] Add metrics and web UI for cluster version summary
...With the introduction of protocol compatibility, once HDFS-2983 is committed, we have the possibility that different nodes in a cluster are running different software versions. To aid operat...
, 2014-09-04, 00:49
[HDFS-3626] Creating file with invalid path can corrupt edit log
...Joris Bontje reports the following:The following command results in a corrupt NN editlog (note the double slash and reading from stdin):$ cat /usr/share/dict/words | hadoop fs -put - hdfs://...
, 2014-09-04, 00:21
[HDFS-4182] SecondaryNameNode leaks NameCache entries
...We recently saw an issue where a 2NN ran out of memory, even though it had a relatively small fsimage. When we looked at the heap dump, we saw that all of the memory had gone to entries in t...
, 2014-09-04, 00:19
[HDFS-3077] Quorum-based protocol for reading and writing edit logs
...Currently, one of the weak points of the HA design is that it relies on shared storage such as an NFS filer for the shared edit log. One alternative that has been proposed is to depend on Bo...
, 2014-09-04, 00:05
[HDFS-3875] Issue handling checksum errors in write pipeline
...We saw this issue with one block in a large test cluster. The client is storing the data with replication level 2, and we saw the following: the second node in the pipeline detects a checksu...
, 2014-09-04, 00:00
[HDFS-4128] 2NN gets stuck in inconsistent state if edit log replay fails in the middle
...We saw the following issue in a cluster: The 2NN downloads an edit log segment:2012-10-29 12:30:57,433 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /xxxxxxx/current/edits_000...
, 2014-09-03, 23:55
[HDFS-3529] Use direct buffers for data in write path
...The write path currently makes several unnecessary data copies in order to go to and from byte arrays. We can improve performance by using direct byte buffers to avoid the copy. This is also...
, 2014-09-01, 04:21
newest on top
oldest on top
Colin Patrick McCabe
Tsz Wo Nicholas Sze
Aaron T. Myers
Uma Maheswara Rao G
Brahma Reddy Battula
last 7 days (1)
last 30 days (2)
last 90 days (6)
last 6 months (9)
last 9 months (283)
Monitor These Apps!
All projects made searchable here are trademarks of the Apache Software Foundation. Service operated by