search

facebookresearch / multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
BSD 3-Clause "New" or "Revised" License
1.44k stars 138 forks source link

add blip2 loss under torchmultimodal/modules/losses #485

Open pikapecan opened 12 months ago

pikapecan commented 12 months ago

Summary: as title

Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648

codecov-commenter commented 12 months ago

Codecov Report

Attention: 38 lines in your changes are missing coverage. Please review.

Comparison is base (b8226b9) 72.58% compared to head (5e21bbf) 73.92%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #485 +/- ## ========================================== + Coverage 72.58% 73.92% +1.33% ========================================== Files 195 205 +10 Lines 13248 14035 +787 ========================================== + Hits 9616 10375 +759 - Misses 3632 3660 +28 ``` | [Files](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) | Coverage Δ | | |---|---|---| | [tests/models/blip2/test\_blip2.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfYmxpcDIucHk=) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_layers.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl9sYXllcnMucHk=) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_model.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl9tb2RlbC5weQ==) | `100.00% <100.00%> (ø)` | | | [tests/models/blip2/test\_qformer\_utils.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kZWxzL2JsaXAyL3Rlc3RfcWZvcm1lcl91dGlscy5weQ==) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/blip2.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9ibGlwMi5weQ==) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_model.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX21vZGVsLnB5) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_utils.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX3V0aWxzLnB5) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/modules/losses/blip2\_losses.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZHVsZXMvbG9zc2VzL2JsaXAyX2xvc3Nlcy5weQ==) | `100.00% <100.00%> (ø)` | | | [torchmultimodal/models/blip2/qformer\_layers.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dG9yY2htdWx0aW1vZGFsL21vZGVscy9ibGlwMi9xZm9ybWVyX2xheWVycy5weQ==) | `96.63% <96.63%> (ø)` | | | [tests/modules/losses/test\_blip2\_loss.py](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-dGVzdHMvbW9kdWxlcy9sb3NzZXMvdGVzdF9ibGlwMl9sb3NzLnB5) | `72.58% <72.58%> (ø)` | | ... and [2 files with indirect coverage changes](https://app.codecov.io/gh/facebookresearch/multimodal/pull/485/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D50148648