search

nytud / emtsv

e-magyar text processing system -- inter-module communication via tsv + REST API
GNU Lesser General Public License v3.0
27 stars 11 forks source link

LFS bandwidth problem #12

Closed DavidNemeskey closed 4 years ago

DavidNemeskey commented 4 years ago

I got the following error message when installing emtsv:

Error downloading object: purepos/szeged.model (07babe0): Smudge error: Error downloading purepos/szeged.model (07babe0a53f0caec60c0a1005bddbc21c3275c88eab27922e22a343e5f316a38): batch response: This repository is over its data quota. Account responsible for LFS bandwidth should purchase more data packs to restore access.
dlazesz commented 4 years ago

Thank you for reporting this issue and sorry for the delayed reply.

The hashes in the error message is originated from an old commit, which refers to an LFS file in a submodule from ppke-nlpg that had been moved in a later commit.

The solution is the following:

Do not clone the full repo only do shallow clone as it is stated in the updated documentation

We are moving away from git submodules and LFS files to use python packages instead. This would solve all LFS related problems. We made good progress, but we need some more time to smooth out the rough edges (e.g. the unified handling of the very large models of emBERT). If you do not wan to use emBERT you can ommit downloading LFS files as all the other modules had moved already.

I close this issue as the documentation has been upgraded to avoid this issue and hopefully soon we can address the root of the problem too.