search

jzhang38 / TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
Apache License 2.0
7.71k stars 453 forks source link

Consider providing safetensor files #97

Closed Calandiel closed 10 months ago

Calandiel commented 10 months ago

Long story short, I'd love to try your model and finetune it for my work but I outright can't without compromising company policy (as loading pickle files is unsafe). I believe in the long run there will be many more people with similar problems. In theory, one could load the file in a sandboxed VM and then export the safetensor file themselves but that's a large hurdle for adoption. Would you consider uploading safetensor files to huggingface too?

jzhang38 commented 10 months ago

Which HF repo are you referring to?

Calandiel commented 10 months ago

The latest one but it looks like safetensors are there already. I'll close the issue