search

wanghenshui / wanghenshui.github.io

my blog, please do not fork
https://wanghenshui.github.io
Other
4 stars 1 forks source link

mysql + s3玩法一例 #105

Closed wanghenshui closed 4 months ago

wanghenshui commented 6 months ago

https://zendesk.engineering/moving-from-dynamodb-to-tiered-storage-with-mysql-s3-cb3dc9bf813a

CREATE TABLE `metadata` (
  `id` binary(16) NOT NULL,
  `end_time_ms` bigint(20) DEFAULT NULL,    # last timestamp this file contains
  `file_path` varchar(255) DEFAULT NULL,    # path of S3 file
  `log_count` int(11) DEFAULT NULL,         # count of the logs this S3 file contains
  `last_log_id` binary(16) NOT NULL, # ULID of last log we processed
);

wanghenshui commented 5 months ago

https://zhuanlan.zhihu.com/p/393555003

愣是搓了一个roaring bitmap类似的设计

wanghenshui commented 5 months ago

https://inria.hal.science/hal-02303490/document

wanghenshui commented 5 months ago

etcd 在超大规模数据场景下的性能优化

https://github.com/etcd-io/bbolt/pull/141 segregated freelist hash统计信息

wanghenshui commented 5 months ago

The importance of being earnestly random: Metamorphic Testing in CockroachDB

一图流

其实有一种数据库服务测试，就是双写，同时写入社区类似的服务和本地服务，对比结果。

pebble这种测试其实就是自己和自己比，对比一致性

wanghenshui commented 5 months ago

https://duanmeng.github.io/ 博客不错