-
Make sure that all significant models save the model space (graph, variables, and definitions) properly and have a script that allows for (1) loading of most recent model, and (2) evaluation of new in…
-
I am running a llamacpp server on local host with phi-2_16.gguf model (as described here: https://github.com/EleutherAI/lm-evaluation-harness/issues/1254).
When running the lm-eval test suite (versio…
-
### Description
E2E ML
- EDA
- Model Training and Evaluation
- Deployment
- Monitoring
### Dataset
https://www.kaggle.com/datasets/johnsmith88/heart-disease-dataset
-
### New Feature Summary
We now have a fair number of batches in the `batches` directory, and many of them used in various evaluation effort in `aapb-evaluaions` repo. To find out for which evaluation…
-
We are looking for a model or a functionality of Ollama that allows us to mock requests and responses without changing the Ollama binary. Basically we want to define a map of requests to responses, e.…
-
### Issue
I think intuitively simply "quit" without a slash should also quit `aider` without using tokens. It might present a message to confirm or such and act like it's grokking the question, but i…
-
Hi! Thanks for the excellent package.
I was wondering if it would be possible to be able to save my association plot and model evaluation plot in a wider format. I am using siamcat for pathway data…
-
### Bug description
After the validation step, the model is not set back to train mode because the following hook
```
def on_validation_model_train(self) -> None:
"""Called when the …
-
## Willingness to contribute
The MLflow Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature (ei…
-
It is currently unclear why some models appear before others when the page is sorted by classification (which is the default).
For example, why isn't XGen before OLMO?
Why aren't the models wi…