Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> murmur3 instead of crc32


+
Radim Kolar 2012-11-26, 02:08
Copy link to this message
-
Re: murmur3 instead of crc32
its not that big speed difference in this test:

http://www.strchr.com/hash_functions#results

asm version of CRC32 on i5 is fastest, but Java8 switched to murmur3 for
hashing strings, i didnt get why they use it instead of

*java.util.zip.CRC32. The collisions seems to be about same.*

+
Todd Lipcon 2012-11-26, 03:38