-
# 🚀 Feature & Motivation
PyTorch/XLA recently launched PyTorch/XLA SPMD ([RFC](https://github.com/pytorch/xla/issues/3871), [blog](https://pytorch.org/blog/pytorch-xla-spmd/), [docs/spmd.md](https:…
-
Hi,
When hipSYCL acts as a library for third party compilers (openmp as an example). What happens exactly? I assume that there is a layer that translates sycl constructs to openmp pragmas so openm…
-
Hello, when I was pre-training the code, I entered：
`CUDA_VISIBLE_DEVICES=0,1 python train.py --source_data pubmed --batch_size 1024 --epochs 30`
There is an error：
> graph_embs, center_embs …
-
Does Earthly have a comparison page in the docs, ie, what makes Earthly distinct from other similarly pleasant build tools? From your front-page docs, and samples, I'm getting warm feelings about Eart…
-
-
Hi there,
have you ever thought about implementing something like a `Network.multiple_runs(N_runs, ..., **run_kwargs)` method, which defines a new network by merging multiple repetitions of `Neuron…
-
### Feature request
## Description
This feature proposal aims to update Hugging Face's support for tensor parallelism (TP) to accommodate the increasing size and complexity of models such as [LLaM…
-
From the discussion in https://github.com/JuliaSymbolics/Symbolics.jl/issues/59#issuecomment-1548434695 , we need to re-evaluate the feasibility to reimplement galgebra in Julia, given the latest prog…
-
In some cases, it can be useful for libraries to support multiple sharding configurations. For example:
- When using only data parallelism, I am OK with the default automatic distributed `jax.Array…
-
Hello!
I'm working through this awesome guide to reduce the size of my compiled binaries. It is making a big difference. While inspecting the result, I used `strings` to take a look at what strin…