xorbitsai / xorbits

Scalable Python DS & ML, in an API compatible & lightning fast way.
https://xorbits.readthedocs.io
Apache License 2.0
1.11k stars 67 forks source link

Feat: Basic datasets getitem #628

Closed codingl2k1 closed 1 year ago

codingl2k1 commented 1 year ago

What do these changes do?

Related issue number

Fixes https://github.com/xorbitsai/xorbits/issues/618

Check code requirements

codecov[bot] commented 1 year ago

Codecov Report

Merging #628 (a8b70c5) into main (2152e9b) will increase coverage by 0.08%. Report is 1 commits behind head on main. The diff coverage is 90.86%.

@@            Coverage Diff             @@
##             main     #628      +/-   ##
==========================================
+ Coverage   93.53%   93.62%   +0.08%     
==========================================
  Files        1021     1022       +1     
  Lines       79059    79237     +178     
  Branches    16400    16437      +37     
==========================================
+ Hits        73950    74187     +237     
+ Misses       3436     3383      -53     
+ Partials     1673     1667       -6     
Flag Coverage Δ
unittests 93.51% <90.86%> (+0.07%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
...bits/datasets/backends/huggingface/to_dataframe.py 77.27% <55.00%> (-19.51%) :arrow_down:
python/xorbits/_mars/utils.py 89.26% <80.95%> (+0.92%) :arrow_up:
...on/xorbits/datasets/backends/huggingface/loader.py 98.93% <93.33%> (-1.07%) :arrow_down:
...n/xorbits/datasets/backends/huggingface/getitem.py 95.40% <95.40%> (ø)
python/xorbits/datasets/dataset.py 95.00% <96.29%> (-2.62%) :arrow_down:
python/xorbits/_mars/services/meta/metas.py 100.00% <100.00%> (ø)
...thon/xorbits/datasets/backends/huggingface/core.py 100.00% <100.00%> (ø)
...ython/xorbits/datasets/backends/huggingface/map.py 100.00% <100.00%> (ø)
...n/xorbits/datasets/backends/huggingface/rechunk.py 100.00% <100.00%> (+6.25%) :arrow_up:

... and 16 files with indirect coverage changes