-
### Describe the feature
I want to continue pre-training llama 2 70b using my own data. My data is about 1b tokens. I have read [Fine-tuning Llama 2 70B using PyTorch FSDP ](https://huggingface.co/bl…
-
## 🚀 Feature
Add a PyTorch implementation of layer-wise adaptive rate scaling (LARS) from the paper "[Large Batch Training of Convolutional Networks](https://arxiv.org/abs/1708.03888)" by You, Gitm…
-
## Steps to reproduce
1. Install ioh==0.3.14 and nevergrad==1.0.0
2. Run the code below under "Relevant Code" twice
3. Observe that the output of the two runs of the ParametrizedMetaModel d…
-
I use roerich on my own dataset, but the result is not so good.
There are commen…
-
Consider the table and query below:
```sql
CREATE TABLE (
k STRING PRIMARY KEY,
a STRING,
INDEX a_idx (a)
);
SELECT * FROM t WHERE k IN (... 1000 items ...) AND a IN (... 1000 items .…
-
Implement different metaheuristics strategies like single solution metaheuristics (trajectory methods like hill-climbing) and population-based metaheuristics (Differential Evolution, PSO, etc.) and vi…
-
### What happened + What you expected to happen
I'd like to customize my `APPOConfig` config dict, specifically the `minibatch_size` attribute / param for `APPOConfig.training`. However, providing…
-
# Description
New optimization algorithms are being developed in the context of classical machine learning, which could find application in training quantum circuit parameters. The core of this pro…
-
@quaquel : Encountered the following issue while running optimization on 60 cores on the HPC. Crashed after the progress of the optimization was 87%. A ValueError in Platypus core triggered Attribute…
-
I would expect this Python implementation to be quite a bit slower than `linalg.solve`. If this is the case, the applications of this would be to use it with custom operators, which PyTorch doesn't cu…