pytorch / torchtune

PyTorch native finetuning library
https://pytorch.org/torchtune/main/
BSD 3-Clause "New" or "Revised" License
4.35k stars 440 forks source link

Make sure CLIP resized pos_embed is contiguous #1986

Closed gau-nernst closed 1 week ago

gau-nernst commented 1 week ago

Context

What is the purpose of this PR? Is it to

Please link to any issues this PR addresses.

Partially address #1978

Changelog

What are the changes made in this PR? *

Test plan

Please make sure to do each of the following if applicable to your PR. If you're unsure about any one of these just ask and we will happily help. We also have a contributing page for some guidance on contributing.

UX

If your function changed a public API, please add a dummy example of what the user experience will look like when calling it. Here is a docstring example and a tutorial example

pytorch-bot[bot] commented 1 week ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/1986

Note: Links to docs will display an error until the docs builds have been completed.

:white_check_mark: No Failures

As of commit b7bff97e3a7b3c2b11a52e34007d144d4d18a495 with merge base ac4f88e19bd9795d6e4861f15a7f7f1f8ed80759 (image): :green_heart: Looks good so far! There are no failures yet. :green_heart:

This comment was automatically generated by Dr. CI and updates every 15 minutes.