-
Split the user-facing rule model from the intermediate representation used for the chase implementation (and possibly from an intermediate representation used for parsing and type inference). Sets the…
-
Hey,
Thanks for creating and maintaining this repository.
I assume that you would be using an LLM to get out the scores for each metric. Or are you guys using some bespoke model for each metric …
-
### 🚀 The feature, motivation and pitch
Implement Fidelity +/- metrics (Fid+ and Fid-) for the purpose of evaluation explainability. This feature request is a part of broader explainability evaluat…
-
### GZDoom version
4.10
### Which game are you running with GZDoom?
Doom 2 and Heretic
### What Operating System are you using?
Windows 11 Home
### A clear and concise description of…
-
I created a small Dataset of my own and observed that the context_relevancy>1
Can I please know what this means?
-
## Question
Thanks for providing a very useful library for applying feature attributions on seq2seq models. I was wondering how you planned on integrating ferret evaluation metrics in Inseq. For in…
-
The size of our prompt was leaving our AI slow. With doc stores and history our prompts were getting into the 1,000 token range and prompt eval time got up to 2 minutes.
When I tried to limit the h…
-
This is a really nice generalization of cloze deletion!
If I were to rewrite a paragraph marked as a flashcard in a way that changes the number or order of the deletions,
would that mess up the sp…
-
Just as a suggestion for new players, I think changing some of the default settings would be wise to make for a more faithful but still enhanced out of the box experience.
My suggestions would be a…
-
Try improving the front end looks by:
- [x] use bootstrap classes (form-control, btn btn-primary)
- [x] Fix sizes of buttons
- [x] align the side panel all to the left (15 pix padding to both sides)
-…