search

facebookresearch / multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
BSD 3-Clause "New" or "Revised" License
1.44k stars 138 forks source link

add blip2 layer under torchmm/models #484

Open pikapecan opened 12 months ago

pikapecan commented 12 months ago

Summary: as title

Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

codecov-commenter commented 12 months ago

Codecov Report

Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (b8226b9) 72.58% compared to head (6e3d7db) 73.71%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #484 +/- ## ========================================== + Coverage 72.58% 73.71% +1.13% ========================================== Files 195 203 +8 Lines 13248 13811 +563 ========================================== + Hits 9616 10181 +565 + Misses 3632 3630 -2 ``` | [Files](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) | Coverage Δ | | |---|---|---| | [tests/models/blip2/test\_blip2.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfYmxpcDIucHk=) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_layers.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl9sYXllcnMucHk=) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_model.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl9tb2RlbC5weQ==) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_utils.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl91dGlscy5weQ==) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/blip2.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9ibGlwMi5weQ==) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_model.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX21vZGVsLnB5) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_utils.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX3V0aWxzLnB5) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_layers.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX2xheWVycy5weQ==) | `96.63% <96.63%> (ø)` | | ... and [1 file with indirect coverage changes](https://app.codecov.io/gh/facebookresearch/multimodal/pull/484/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50145708