Open a-rose opened 2 months ago
Perhaps you could consider git LFS instead?
It was considered
The free limit is 1 GB
Oh wow, I had no idea there was a storage or bandwidth limitation
What about huggingface.co? I know they host some fairly large models and data sets, but I'm unclear on the pricing.
Came across this issue since we also saw lots of build failures in the last weeks / months. I don't have a real solution but we traced this down to this particular file being slow for everyone on a Deutsche Telekom DSL line. (This might as well affect other providers using the same peers as DTAG and OVH).
We could even verify the slowness with their load test files for the Montreal DC https://bhs.proof.ovh.ca/
For the time being we wonder if we should just mirror the file locally and have the build script pick it up from there.
At the time of writing, media.xiph.org seems to be inaccessible, which causes a compile block when downloading the model data (https://media.xiph.org/opus/models/opus_data-735117b.tar.gz).
In #337 it was mentioned that this file was too large to push to the repo, but storing it on an independent web server doesn't seem like an ideal solution. Perhaps you could consider git LFS instead?