-
### Describe the bug
Create a dataset. Save it to disk. Load from disk. Shuffle, usning a `np.random.Generator`. Iterate. Shuffle again. Iterate. The iterates are different since the supplied np.rand…
-
Hi,
thanks for working on this data generator. We are using the generated FinBench datasets for our research and would kindly ask to support larger SFs in the generator than the currently supported f…
-
!pip install transformers datasets
from transformers import GPT2Tokenizer, GPT2LMHeadModel, Trainer, TrainingArguments
from datasets import load_dataset, load_metric
tokenizer = GPT2Tokenizer.from_…
-
First,thank you for your amazing work!
could you send the program for generate datasetes(like the bigbird datasets) ? Or samething like the datasets file construct?
In my opinion ,the datasets stru…
-
!pip install transformers datasets
from transformers import GPT2Tokenizer, GPT2LMHeadModel, Trainer, TrainingArguments
from datasets import load_dataset, load_metric
from transformers import GPT2LMH…
-
Hi,
Thank you for sharing your code!
I'm trying to train segCLR with my own dataset, and your code is very helpful (:
I've noticed there are several files called dataset or dataset preprocessin…
LtlSh updated
8 months ago
-
While executing the file in folder `Olive/examples/llama2` i got the error of
TypeError: LlamaForCausalLM.forward() got an unexpected keyword argument 'past_key_values.0.key'
while executing :
`py…
-
Downloading data: 100%|████████████████████| 2.04G/2.04G [10:08
-
Hi everyone
my generator is not producing images and stops with the first epoch
> Epoch 1/5
> ---------------------------------------------------------------------------
> StopIteration …
-
**I have added --tasks hendrycksTest* in my command, but gotten this error:**
Selected Tasks: ['hendrycksTest-college_medicine', 'hendrycksTest-high_school_macroeconomics', 'hendrycksTest-security_…