xorbitsai / xorbits

Scalable Python DS & ML, in an API compatible & lightning fast way.
https://xorbits.readthedocs.io
Apache License 2.0
1.11k stars 67 forks source link

BUG: Fix Huggingface dataset loader filelock conflict #633

Closed codingl2k1 closed 1 year ago

codingl2k1 commented 1 year ago

What do these changes do?

Related issue number

Fixes https://github.com/xorbitsai/xorbits/issues/632

Check code requirements

codecov[bot] commented 1 year ago

Codecov Report

Merging #633 (eb89385) into main (02bebe1) will decrease coverage by 3.79%. The diff coverage is 43.47%.

@@            Coverage Diff             @@
##             main     #633      +/-   ##
==========================================
- Coverage   93.61%   89.83%   -3.79%     
==========================================
  Files        1022     1022              
  Lines       79237    79235       -2     
  Branches    16437    16437              
==========================================
- Hits        74180    71179    -3001     
- Misses       3397     6215    +2818     
- Partials     1660     1841     +181     
Flag Coverage Δ
unittests 89.72% <43.47%> (-3.79%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
...xorbits/_mars/learn/contrib/lightgbm/classifier.py 85.18% <0.00%> (-3.71%) :arrow_down:
...hon/xorbits/_mars/learn/contrib/lightgbm/ranker.py 85.18% <0.00%> (-3.71%) :arrow_down:
.../xorbits/_mars/learn/contrib/lightgbm/regressor.py 85.71% <0.00%> (-3.58%) :arrow_down:
.../xorbits/_mars/learn/contrib/xgboost/classifier.py 95.12% <0.00%> (-2.44%) :arrow_down:
python/xorbits/_mars/learn/contrib/xgboost/core.py 83.33% <0.00%> (-2.78%) :arrow_down:
...n/xorbits/_mars/learn/contrib/xgboost/regressor.py 91.30% <0.00%> (-4.35%) :arrow_down:
python/xorbits/_mars/lib/mkl_interface.py 40.00% <75.00%> (ø)
...on/xorbits/datasets/backends/huggingface/loader.py 98.91% <100.00%> (-0.03%) :arrow_down:

... and 128 files with indirect coverage changes