TODO 20240302

[wanghenshui]

https://bloomberg.github.io/bde/articles/wyhash.html#benchmark-comparisons

测试murmurhash3 32 vs crc32 硬件

[wanghenshui]

brpc::flatmap vs absl::flatmap ?

[wanghenshui]

https://juejin.cn/post/6961414532715511839

[wanghenshui]

http://chaoran.me/assets/pdf/ws-spaa16.pdf

chaorenyang他的工作需要挨个看一下。这个之前就收藏过，偷懒了没看

http://chaoran.me/

[wanghenshui]

block checksum mismatch

大概率盘坏，搜到的解决方案都是重建为主

https://tracker.ceph.com/issues/48002 重建 https://forums.percona.com/t/unable-to-run-due-to-rocksdb-error/16654 重建 https://groups.google.com/g/rocksdb/c/io7y5AqxDkk/m/VnTLHbq5AQAJ 认为是硬件问题 https://groups.google.com/g/rocksdb/c/gUD4kCGTw-0/m/SpTzOgS8AgAJ 尝试scan 重建sst结果搞坏两份备份 https://github.com/apache/bookkeeper/pull/3568 7.4有bug升级到7.5

fixed after 7.4.0. The fix is followed

Fixed a bug in WriteBatchInternal::Append() where WAL termination point in write batch was not considered and the function appends an incorrect number of checksums.

https://github.com/arangodb/arangodb/issues/9801 结论？

http://47.241.45.216/2023/01/22/Fast21-RocksDB/ 还是备份。数据损坏是一种必然

https://asktug.com/t/topic/782830?replies_to_post_number=3 盘坏，阿里云是ceph改 https://asktug.com/t/topic/1022009 云盘坏 https://tidb.net/blog/54e388c8?_gl=1*k883y2*_ga*MjA3MTYxNTczMS4xNzA5MTAxODM4*_ga_D02DELFW09*MTcwOTEwMTgzNy4xLjEuMTcwOTEwMjE5OC4wLjAuMA.. 删数据 删副本 tidb是混合的 https://asktug.com/t/topic/1009328?replies_to_post_number=20 盘坏 https://asktug.com/t/topic/69009/21?page=2

https://github.com/facebook/rocksdb/issues?q=checksum+mismatch+ 看一遍

[wanghenshui]

查端口 ss -tnlp | grep ssh netstat -tnlp | grep ssh lsof -i -P | grep ssh

[wanghenshui]

merge 很慢 https://stackoverflow.com/questions/75205703/rocksdb-merge-operarator-performance-is-very-slow-for-large-number-of-keys

[wanghenshui]

https://zhuanlan.zhihu.com/p/492191158 https://zhuanlan.zhihu.com/p/474319554 https://zhuanlan.zhihu.com/p/683775984 https://zhuanlan.zhihu.com/p/556101318 https://zhuanlan.zhihu.com/p/589247715 https://www.micahlerner.com/2022/01/08/shard-manager-a-generic-shard-management-framework-for-geo-distributed-applications.html https://cloud.tencent.com/developer/news/704677 https://zhuanlan.zhihu.com/p/550505389 https://www.youtube.com/watch?v=7ivbp9G-8_0

[wanghenshui]

https://www.uber.com/en-DE/blog/how-uber-serves-over-40-million-reads-per-second-using-an-integrated-cache/

[wanghenshui]

https://blog.peerdb.io/moving-a-billion-postgres-rows-on-a-100-budget

[wanghenshui]

https://www.aspiring.dev/fly-io-scheduler-part-2/

[wanghenshui]

https://xata.io/blog/pgroll-schema-migrations-postgres

[wanghenshui]

https://tontinton.com/posts/scheduling-internals/

[wanghenshui]

https://doordash.engineering/2024/02/27/introducing-doordashs-in-house-search-engine/

[wanghenshui]

https://www.tumuchdata.club/post/modern-buffer-managers-2/

[wanghenshui]

https://blog.schmizz.net/designing-serverless-stream-storage

[wanghenshui]

https://cloud.google.com/blog/products/storage-data-transfer/a-peek-behind-colossus-googles-file-system

[wanghenshui]

https://blog.schmizz.net/disaggregated-wal

[wanghenshui]

https://www.gomomento.com/blog/fighting-off-fake-serverless-bandits-with-the-true-definition-of-serverless

[wanghenshui]

https://www.uber.com/blog/schemaless-sql-database/?uclick_id=e45272d4-2a0a-43c9-a3da-14ff08bf1855&_gl=1*1ys9uca*_ga*MTI0MDY3OTYyNi4xNzA4MzEzNTgx*_ga_XTGQLY6KPT*MTcwODMxMzU4MC4xLjEuMTcwODMxMzU4MC4wLjAuMA..&_ga=2.116894272.790479044.1708313581-1240679626.1708313581

[wanghenshui]

https://www.scylladb.com/2024/02/12/distributed-database-consistency-dr-daniel-abadi-kostja-osipov-chat/?utm_source=thenewstack&utm_medium=twitter&utm_campaign=platform

[wanghenshui]

https://www.youtube.com/watch?v=r-TLSBdHe1A

[wanghenshui]

https://github.com/plasma-umass/coz

[wanghenshui]

https://www.forrestthewoods.com/blog/benchmarking-malloc-with-doom3/

[wanghenshui]

https://www.agner.org/optimize/optimizing_cpp.pdf

[wanghenshui]

https://www.agner.org/optimize/optimizing_assembly.pdf

[wanghenshui]

https://www.agner.org/optimize/microarchitecture.pdf

[wanghenshui]

https://www.agner.org/optimize/instruction_tables.pdf

[wanghenshui]

https://www.agner.org/optimize/calling_conventions.pdf