-
## Description
We need to implement an algorithm for generating computation graphs. This algorithm should efficiently create and manage computation graphs, which are essential for various computati…
-
Recognizing Steps to controlling the size of the data going into storage
Currently the system has 4 TB or storage. It is important to contoll the size of the data that is used for the model when sor…
-
Starting from the `SolverOrbitalHorovod` class, study the possibility to distribute the calculation over multiple GPUs. Both the sampling and the optimization are distributed. I'm not sure if the clas…
-
### Motivation
I am attempting to use optuna for hyperparameter optimization of a complex, lightning based deep learning framework. It is essential for this framework to run in a distributed setting.…
-
Good afternoon! I recently ran into an issue where there is pattern discrepancy between runs with sparseOptimization set to TRUE versus FALSE. The code I ran and the output is below. With sparseOptimi…
-
Since the XGBoost 1.6, we have been working on having multi-output support for the tree model. In 2.0, we will have the initial implementation for the vector-leaf-based multi-output model. This issue …
-
* Move resource loading to the renderer process
The module of resource loading is located and run in browser process.
It causes performace degradation because resources are sent to renderer proce…
nke94 updated
5 years ago
-
import argparse
import os
import deepspeed
import torch
import torch.nn as nn
import torch.nn.functional as F
import torchvision
import torchvision.transforms as transforms
from deepspeed.accelerator…
-
```
[2024-09-02 00:39:59,451] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING] Please specify the CUTLASS repo directory as environment varia…
-
### System Info
```Shell
- `Accelerate` version: 1.0.0
- Platform: Linux-6.8.0-47-generic-x86_64-with-glibc2.35
- `accelerate` bash location: /home/user/anaconda3/envs/accelerate_multi/bin/accelera…