-
Hi Unsloth team,
Thank you very much for the great work!
May I ask if unsloth FastInference model support perplexity calculation?
For example, in the REPLUG paper, they use perplexity of generating…
-
I haven't been able to see what's going on.
If I install `onnxruntime` on one side and `fastinference` on the other, everything works fine*. But if I install `fastinference[onnx-cpu]` it installs t…
-
One nice feature would be if `get_preds` could return the class names rather than `tensor(0)` when passing `with_decoded`. I've done this within fastinference but of course this isn't nice as it's mor…
-
Hello, thank you for this repo. I am trying to run the TabNet notebook on a custom data set, have got everything working up to the explainability decorator which fails with this error:
```
-------…
-
Please confirm you have the latest versions of fastai, fastcore, and nbdev prior to reporting a bug (delete one): YES
**Describe the bug**
Running a prediction on Fastai 2.7.14 produces "Attribute…
-
Hi, great implementation Im impressed by the accuracy of one shot looking forward to the finetune training code released.
In the meantime could you tell me how to change similarity and stability in …
-
Running pip install fastinference[interp] is not working. I have the latest version of SHAP (0.39) already installed. Seems like it is crashing when trying to run setup.py for SHAP. fastinference s…
-
Hi there,
I am getting the following error when I try to run this part. Any thoughts?
`fastai::install_fastai(gpu = FALSE, cuda_version = '10', overwrite = FALSE)`
r-miniconda/envs/r-reticula…
-
Hi,
I have a use case where I need multiple predictions and their probabilities - if the model is not confident enough in the prediction, the user gets a choice of N top predictions to choose the cor…
-
Hi.
I’m currently going through Lesson 2 using the ClassConfusion class in Google Colab in the following way:
`ClassConfusion(interp, classes, is_ordered=False, figsize=(8,8))`
When I ran the…