kbressem / medAlpaca

LLM finetuned for medical question answering
GNU General Public License v3.0
491 stars 57 forks source link

medAlpaca-lora-7b-8bit Checkout error #48

Open alireza0r opened 1 year ago

alireza0r commented 1 year ago

Hi @kbressem I attempted to execute the MedAlpaca model from Hugging Face's source, but it appears that the MedAlpaca Hugging Face checkpoint has been removed. When using the 'pipeline' and 'AutoModel' with 'medalpaca/medalpaca-lora-7b-8bit,' I receive the error message: 'medalpaca/medalpaca-lora-7b-8bit does not appear to have a file named config.json. Checkout https://huggingface.co/medalpaca/medalpaca-lora-7b-8bit/main for available files.' Additionally, I've noticed that MedAlpaca doesn't work with the 'Hosted inference Hugging Face API.'

How can I resolve this issue? Thanks a lot.