search

alexandrainst / coral

Danish ASR and TTS models associated with the CoRal project.
MIT License
9 stars 1 forks source link

Fix/increase shard size #39

Closed saattrupdan closed 1 year ago

saattrupdan commented 1 year ago

Hugging Face Hub has a limit to number of commits we can make per hour, so to mitigate that I'm increasing the shard size from 50MB to 500MB.

saattrupdan commented 1 year ago

LGTM. Annoying that HF counts shards as separate commits :P

If this is something that we are going to continually tweak, it might be desirable to have shard size in configuration.

Edit: I am wrong, shard size is only used by scripts that are not run by Hydra, it seems, so forgettaboutit

Yeah, alternatively we replace the click scripts with hydra instead, and include the shard size in the config. Anyway, let's worry about that later 🤷