-
When following the [Python benchmark guide](https://github.com/lancedb/lance/blob/main/python/DEVELOPMENT.md#benchmarks) I get the following errors:
```$ pytest python/benchmarks -m "not slow"
===…
-
### Feature request
I would like to make an example notebook for evaluating the peft model for reproducable tasks and metrics using the lm-eval harness if possible .
Library here - https://github.…
-
Traceback (most recent call last):
File "/dataset-vlm/jingyaoli/LLMInfer/InfLLM/benchmark/pred.py", line 327, in
preds = get_pred(
File "/dataset-vlm/jingyaoli/LLMInfer/InfLLM/benchmark/pr…
-
Hi All,
Thank you for your excellent work!
I have 2 questions:
1. You request to organize the dataset as follow:
```
ONCE_Benchmark
├── data
│ ├── once
│ │ │── ImageSets
| | | ├──…
-
The above two datasets are also frequently used benchmarks in few-shot-learning
Do you have any plans to provide code support for that part?
-
One can [(re)write a dataset (partitioned or not) without reading the full thing into memory with pyarrow](https://arrow.apache.org/docs/python/dataset.html#writing-datasets). We currently have a benc…
-
Is the scaf dataset publicly available? Where can I obtain it?
-
Hello,
I follow the readme file's step and set the DIV2K dataset and set '--dir_data' as the HR and LR image path.
But when I try to train the model , there seems to be a missing dataset dir_data/be…
-
We can use:
https://github.com/tiago4orion/DataGen
To generate lots of data and then we can evaluate how fast we really are :-)
-
I was wondering if you still have the dataset you used to create the deep learning graphs in your paper. I think these datasets can be a very interesting benchmark. The deep offline RL space is curren…