| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
16 (2.829s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...It does not work for me OK. Its way too slow. i got just 2k LOC in committed and still floating around patches. That is real and sad result of 1/2 year of cooperation. I know tha...
|
|
|
Author: Radim Kolar,
2012-12-08, 04:39
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...YARN-223 YARN-211 YARN-210 MAPREDUCE-4839 MAPREDUCE-4827 MAPREDUCE-4594 MAPREDUCE-3968 HADOOP-9088 HADOOP-9041 HADOOP-8698 ...
|
|
|
Author: Radim Kolar,
2012-12-06, 02:02
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...Its not about writing patches, its about to get them committed. I have experience that getting something committed takes months even on simple patch. I have about 10 patches floa...
|
|
|
Author: Radim Kolar,
2012-12-05, 02:00
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...Good units tests will catch code modifications like: from: long getLastByteOffsetBlock() { return lastByteOffsetInBlock; &n...
|
|
|
Author: Radim Kolar,
2012-12-04, 17:39
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...thank you for your code, i got it merged with trunk. HDFS is crap code, private methods not documented at all, and unit tests are joke. I did some random code changes and s...
|
|
|
Author: Radim Kolar,
2012-12-04, 17:07
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
... > Hoping to find time to get back to finishing the patches in the next few months. Todd, just attach these pathes to jira, they do not even needs to apply cleanly...
|
|
|
Author: Radim Kolar,
2012-11-29, 15:17
|
|
|
[HDFS-4225] Improve HDFS write performance - HDFS - [issue]
|
|
...Collection of tickets related to HDFS write performance....
|
|
|
http://issues.apache.org/jira/browse/HDFS-4225
Author: Radim Kolar,
2012-11-26, 18:00
|
|
|
Re: profiling hdfs write path - HDFS - [mail # dev]
|
|
...can you attach crc path there? https://issues.apache.org/jira/browse/HDFS-3528 i will finish it....
|
|
|
Author: Radim Kolar,
2012-11-26, 03:07
|
|
|
Re: murmur3 instead of crc32 - HDFS - [mail # dev]
|
|
...its not that big speed difference in this test: http://www.strchr.com/hash_functions#results asm version of CRC32 on i5 is fastest, but Java8 switched to murmur3 for hashin...
|
|
|
Author: Radim Kolar,
2012-11-26, 02:58
|
|
|
murmur3 instead of crc32 - HDFS - [mail # dev]
|
|
...i just tested C version and murmur3 32_le is about 4 times faster then CRC32. I submitted yesterday murmur3 hash support. What it takes to change checksum method, does .metadata ...
|
|
|
Author: Radim Kolar,
2012-11-26, 02:08
|
|
|
|
