search

facebookresearch / multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
BSD 3-Clause "New" or "Revised" License
1.44k stars 138 forks source link

create configuration file for MaMMUT training #521

Closed zhangtemplar closed 7 months ago

zhangtemplar commented 8 months ago

Summary: Mostly based on original coca and https://github.com/lucidrains/MaMMUT-pytorch

Update the logics of loading checkpoint for MaMMUT text decoder as well.

Differential Revision: D52891614

Privacy Context Container: 303860477774201

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

codecov-commenter commented 8 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (1cccc58) 75.61% compared to head (edac526) 75.61%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #521 +/- ## ========================================== - Coverage 75.61% 75.61% -0.01% ========================================== Files 234 234 Lines 16123 16122 -1 ========================================== - Hits 12192 12191 -1 Misses 3931 3931 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 8 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 7 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 7 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 7 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 7 months ago

This pull request was exported from Phabricator. Differential Revision: D52891614

facebook-github-bot commented 7 months ago

This pull request has been merged in facebookresearch/multimodal@2cbab1f089ae84b557bf19bd91ff03d4efd4b1d9.