Open simonseyer opened 1 year ago
Hi,
I've downloaded https://huggingface.co/distilgpt2/tree/main/coreml/text-generation and tried to use it with huggingface/swift-chat. Unfortunately, it fails with the assert at LanguageModel.swift#L130 because the model uses token_scores.
token_scores
Reading your documentation/blog post, I thought distilgpt2 should be supported. Did I use a wrong model, maybe?
distilgpt2
It's also the only model currently supported that is small enough to be included in a mobile app, from what I can tell?
Sorry if these are dumb questions — quite new to the field :) Thank you in advance
Hi,
I've downloaded https://huggingface.co/distilgpt2/tree/main/coreml/text-generation and tried to use it with huggingface/swift-chat. Unfortunately, it fails with the assert at LanguageModel.swift#L130 because the model uses
token_scores.Reading your documentation/blog post, I thought
distilgpt2should be supported. Did I use a wrong model, maybe?It's also the only model currently supported that is small enough to be included in a mobile app, from what I can tell?
Sorry if these are dumb questions — quite new to the field :) Thank you in advance