pytorch / torchchat

Run PyTorch LLMs locally on servers, desktop and mobile
BSD 3-Clause "New" or "Revised" License
3.4k stars 224 forks source link

Add multimodal to possible tests #1382

Closed mikekgfb closed 6 days ago

mikekgfb commented 1 week ago

1 - Complete markup for testing 2 - add test extraction from multimodal.md to run-docs 3 - run generated test from git workflows

Notes: a - need to use actual llama model because stories models do not support multimodal inputs b - this will require HF access tokens which are currently not necessary because stories models can be downloaded without tokens c - use of HF access tokens are currently not used (?), so might require additional setup

pytorch-bot[bot] commented 1 week ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1382

Note: Links to docs will display an error until the docs builds have been completed.

:heavy_exclamation_mark: 2 Active SEVs

There are 2 currently active SEVs. If your PR is affected, please view them below:

:white_check_mark: No Failures

As of commit 4c4011c3bf69438661f7388a57fa7ef1a110e376 with merge base 5da240a85093e46cf6f4b9649476329fa561ecbc (image): :green_heart: Looks good so far! There are no failures yet. :green_heart:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Jack-Khuu commented 6 days ago

Thanks for starting MM testing, we’ll need to polish to make this test useful (failing silently unrelated to MM I think)

Let’s find a good solution to testing 11b prior to landing to avoid a false sense of confidence

cc: @Gasoonjia