-
Hey Team,
I'm trying to use FSDP1/2 with Float8InferenceLinear but seems have some issues (with torch 2.3.1+cu118). Do you suggestion to bump to higher version of torch and have a try or maybe use …
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
使用最新版的lmdeploy 0.5.1在多卡V100或者…
-
I wanna know if dynamic indexing is supported in triton. For, example, can I load a value tensor based on another index tensor instantiated at runtime like below?
```
indicies_ptr = index_ptr + p…
-
This issue is a follow-on to #17883 which re-defined `.indices` on arrays to make it more distinct from `.domain`. Specifically, the goal of this issue is to ensure that we're in agreement about when…
-
# Problem Statement
For search, ads or recommenders systems, the embeddings are large and pose challenges on the deep learning system for efficient computation, memory, storage and networking. For…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
**Describe the bug**
When I upgrade to DeepSpeed 0.14.3, training does not progress because all gradients and gradient norms are zero. From using git bisect, I think it's from this PR:
https://git…
-
Hi,
I am currently working on implementing your optimization module (conjugate gradient method) to solve a linear system.
The system that I am trying to solve is, simple 2D Poisson equation. T…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N…
jgen1 updated
3 weeks ago
-
While sparse arrays are [supported in dask](http://dask.pydata.org/en/latest/array-sparse.html), this issue aims to open the discussion on how this could be applied in the the context of dask-ml.
…