account: rework bucket refresh

[murlock]

SUMMARY

The compute of refresh for a bucket is now done by batch:

• a lock key is created and will hold ctime, mtime and marker.
• bucket info is set to 0
• a batch will parses at most 10000 containers and will update stats.
• when a container for this bucket is updated, it will check if lock key exists. If it exists, the bucket stats will be updated if container name is already parsed by refresh operation (name is before or equal to marker)

ISSUE TYPE

• Bugfix Pull Request

COMPONENT NAME

account

SDS VERSION

5.6.1dev2

[codecov-io]

Codecov Report

Merging #2085 into 5.x will increase coverage by 0.16%. The diff coverage is 95.61%.

@@            Coverage Diff             @@
##              5.x    #2085      +/-   ##
==========================================
+ Coverage   78.67%   78.82%   +0.16%     
==========================================
  Files         378      391      +13     
  Lines       73463    74089     +626     
  Branches     6967     6967              
==========================================
+ Hits        57788    58393     +605     
- Misses      15576    15597      +21     
  Partials       99       99              

Impacted Files	Coverage Δ
oio/account/backend.py	70.11% <85.19%> (+2.77%)	:arrow_up:
tests/functional/account/test_backend.py	100.00% <100.00%> (ø)
meta0v2/meta0_remote.c	78.05% <0.00%> (-7.31%)	:arrow_down:
meta1v2/meta1_prefixes.c	75.78% <0.00%> (-3.60%)	:arrow_down:
oio/content/plain.py	72.42% <0.00%> (-3.44%)	:arrow_down:
proxy/sqlx_actions.c	81.06% <0.00%> (-2.64%)	:arrow_down:
oio/blob/indexer.py	66.67% <0.00%> (-2.27%)	:arrow_down:
sqliterepo/sqlx_remote.c	81.33% <0.00%> (-1.80%)	:arrow_down:
meta1v2/meta1_server.c	69.68% <0.00%> (-1.63%)	:arrow_down:
oio/crawler/integrity.py	67.90% <0.00%> (-1.42%)	:arrow_down:
... and 56 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update c0d5241...7f4485b. Read the comment docs.