-
adding a feature that compares feature importance or SHAP/LIME results across multiple models
-
### Feature request
Add an option to the RLOOTrainer that enables the use of string-based reward models, such as BLEU and Levenshtein distance, for evaluating model outputs.
### Motivation
Curren…
-
**Is your feature request related to a problem? Please describe.**
**Describe the solution you'd like**
finalize the design for schema of middle layer that transform outer MR logical model to [KFM…
-
- [x] Implement Bayes factor
- [x] Grid search for initialization hyperparameters: including number of folds
- [ ] check variance in the results for different initializations (different initialization…
-
The tool will run a "tournament" where applicants are compared in pairs, and the results of the comparisons are used to determine overall ranking.
1. Take a list of applicants
2. Conduct pairwise com…
-
As spoken, please prepare a benchmark comparison for different models on the same open source or industry dataset.
The objective is to tell I&E how good is our new models.
-
First of all, I would like to extend my gratitude to @nisargjhaveri for creating this project.
I tried this on my Pi Zero W and Pi Zero 2W (Car: Honda City 2022, Phone: Galaxy S22 Ultra). However, …
-
Thank you for great work!
when I tested the time cost of linfusion and the dreamshape-v8-base model, I found that linfusion took an average of **1.8s** on A100, but the average time consumption of…
-
Currently all the MCC happens in the visualization code and not on the `Result` object. Maybe we could do this on the Result object / consolidate the code. The default options should probably be simi…
-
There exists models [finetuned for structured extraction](https://numind.ai/blog/nuextract-a-foundation-model-for-structured-extraction):
[NuExtract-tiny](https://huggingface.co/numind/NuExtract-ti…