jrzaurin / pytorch-widedeep

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
Apache License 2.0
1.3k stars 190 forks source link

Large datasets #194

Closed jrzaurin closed 1 year ago

jrzaurin commented 1 year ago

Created the load_from_folder module in response to issue #150:

Examples and docs also added

codecov[bot] commented 1 year ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (1c8709f) 95.34% compared to head (59ab075) 95.01%. Report is 107 commits behind head on master.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #194 +/- ## ========================================== - Coverage 95.34% 95.01% -0.34% ========================================== Files 97 109 +12 Lines 5697 6615 +918 ========================================== + Hits 5432 6285 +853 - Misses 265 330 +65 ``` | [Files](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier) | Coverage Δ | | |---|---|---| | [...h\_widedeep/bayesian\_models/\_base\_bayesian\_model.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9iYXllc2lhbl9tb2RlbHMvX2Jhc2VfYmF5ZXNpYW5fbW9kZWwucHk=) | `92.00% <ø> (ø)` | | | [...esian\_models/tabular/bayesian\_embeddings\_layers.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9iYXllc2lhbl9tb2RlbHMvdGFidWxhci9iYXllc2lhbl9lbWJlZGRpbmdzX2xheWVycy5weQ==) | `97.89% <ø> (ø)` | | | [pytorch\_widedeep/callbacks.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9jYWxsYmFja3MucHk=) | `92.68% <ø> (+0.13%)` | :arrow_up: | | [pytorch\_widedeep/dataloaders.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9kYXRhbG9hZGVycy5weQ==) | `92.00% <ø> (-3.84%)` | :arrow_down: | | [pytorch\_widedeep/datasets/\_\_init\_\_.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9kYXRhc2V0cy9fX2luaXRfXy5weQ==) | `100.00% <ø> (ø)` | | | [pytorch\_widedeep/datasets/\_base.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9kYXRhc2V0cy9fYmFzZS5weQ==) | `100.00% <ø> (ø)` | | | [pytorch\_widedeep/initializers.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9pbml0aWFsaXplcnMucHk=) | `96.00% <ø> (ø)` | | | [pytorch\_widedeep/load\_from\_folder/\_\_init\_\_.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9sb2FkX2Zyb21fZm9sZGVyL19faW5pdF9fLnB5) | `100.00% <ø> (ø)` | | | [...ytorch\_widedeep/load\_from\_folder/image/\_\_init\_\_.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9sb2FkX2Zyb21fZm9sZGVyL2ltYWdlL19faW5pdF9fLnB5) | `100.00% <ø> (ø)` | | | [...dedeep/load\_from\_folder/image/image\_from\_folder.py](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier#diff-cHl0b3JjaF93aWRlZGVlcC9sb2FkX2Zyb21fZm9sZGVyL2ltYWdlL2ltYWdlX2Zyb21fZm9sZGVyLnB5) | `85.48% <ø> (ø)` | | | ... and [63 more](https://app.codecov.io/gh/jrzaurin/pytorch-widedeep/pull/194?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Javier) | |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.