awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

ValueError: Unsupported model type falcon #35

Open shenshaoyong opened 1 year ago

shenshaoyong commented 1 year ago

When running this https://github.com/awslabs/llm-hosting-container/blob/main/examples/huggingface/huggingface-large-model-inference-falcon-7b.ipynb, the error "ValueError: Unsupported model type falcon" pops up. So what's the possible root cause for this.