-
### Describe the bug
Open https://tiddlywiki.com/#%24%3A%2Feditions%2Ftw5.com%2Fwikitext-macros
See
```
\procedure tw-code(tiddler)
\end
\procedure tw-code-link(tiddler)
[[$tiddler$]]…
-
**Describe the bug**
Using the OGA tokenizer to encode the wikitext-2-raw-v1 hangs and does not return, but works fine for wikitest-2-v1.
**To Reproduce**
Steps to reproduce the behavior:
import…
WA225 updated
1 month ago
-
## 🐛 Bug
**Describe the bug**
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-2-v1.zip
This exception is thr…
-
Hi
I am PhD student and I want to use the WikiGraphs dataset for my next research topic. While downloading and making Vocab, I got the following error:
FileNotFoundError: [Errno 2] No such file …
-
This comes out of #86 and some related discussions on how you can reduce the need for wikitext in the Commons extension.
The idea is that you could ship the CommonsExtension with a handful of schem…
-
!pip install transformers datasets
from transformers import GPT2Tokenizer, GPT2LMHeadModel, Trainer, TrainingArguments
from datasets import load_dataset, load_metric
tokenizer = GPT2Tokenizer.from_…
-
Hi, can you please share pipeline for the wikitext dataset. I found results with 16.3 for mamba and 18 (vs. 18.6 everywhere else) perplexity for the transformer baseline and can not reproduce it. Mayb…
-
Hi, when I use the command for evaluating Llama-2 7B on wikitext2:
lm_eval --model hf --model_args pretrained=meta-llama/Llama-2-7b-hf --tasks wikitext --device cuda:0 --batch_size 1
…
-
Test case:
```python
import mwparserfromhell
wikitext = """
{{cite news | first=109th Congress, 1st Session | last=U.S. Senate | title= S. 1033, Secure America and Orderly Immigration Act | d…
harej updated
3 weeks ago
-
| --- | --- |
| Bugzilla Link | [468622](https://bugs.eclipse.org/bugs/show_bug.cgi?id=468622) |
| Status | NEW |
| Importance | P3 normal |
| Reported | May 28, 2015 09:10 EDT |
| Modified | Aug…