search

pytorch / benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
BSD 3-Clause "New" or "Revised" License
817 stars 259 forks source link

`DALLE2_pytorch` moved to `canary_models` due to NumPy 2.0 upgrade. #2339

Open ysiraichi opened 5 days ago

ysiraichi commented 5 days ago

In #2311, DALLE2_pytorch benchmark was moved into canary_models due to the NumPy 2.0 upgrade. I'm opening this issue for tracking the progress towards moving it back to the models folder.

xuzhao9 commented 5 days ago

We remove DALLE2_pytorch because the upstream model depends on embedding-reader, which further depends on numpy<2: https://github.com/rom1504/embedding-reader/blob/a4fd55830a502685600ed8ef07947cd1cb92b083/requirements.txt#L3

We don't have plan to add numpy>=2 support to embedding-reader. Therefore, we can't really add back this model unless upstream repo fixes this issue.