-
This is the script:
from mario_gpt import MarioLM
mario_lm = MarioLM()
prompts = ["many pipes, many enemies, some blocks, high elevation"]
generated_level = mario_lm.sample(
prompts=p…
-
I was running the polygraph_eval with this example config https://github.com/IINemo/lm-polygraph/blob/main/examples/configs/polygraph_eval_wmt14_ende.yaml
I got a warning about too long string
…
-
There is a method to run projectR on sparse data, but it fails with an error.
https://github.com/genesofeve/projectR/blob/39b3b0fdda3cca5419fa424705c79e979acef2a7/R/projectR.R#L88
To reproduce:
…
-
When I try to run `make -f Makefile` on Windows 11 or `make -f Makefile-Linux` on WSL2 I get following output:
```
gcc -Wall -O3 -o max2sphere max2sphere.o bitmaplib.o -ljpeg -lm
max2sphere.o: f…
-
**Describe the bug**
Downloaded https://huggingface.co/google-bert/bert-base-uncased/blob/main/tf_model.h5 to local machine and ran modelscan --show-skipped -p ./models/bert-base-uncased/tf_model.h5 …
-
we can include somewhere in the main readme,md saying we can get the list of tasks using the below command
```
lm-eval --tasks list
```
-
Hello, I would like to PR a new feature, which allows FlashAttention to support backpropagation through log-sum-exponent (LSE).
In other words, the mha_bwd function signature (in pseudocode) is cu…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Tested Build
#1200
### Android Version
12
### SoC type
Snapdragon
### Device GSMArena lin…
-
This is an issue to discuss the feasibility / desirability of multimodal benchmarks to be included and supported in lm-eval. With the increase in multimodal (V)LMs and in benchmarks like MMMU designed…
-
Installed LiteX on a new VM.
```bash
litex_sim --cpu-type=cv32e41p
```
Stalls:
```bash
[...]
g++ veril.o sim_init.o verilated.o verilated_vcd_c.o Vsim__ALL.a modules.o pads.o sim.o libdyl…