-
#### **Objective**
Develop a `fused_rotary_embedding` Op to apply ROPE on `q` and `k` tensors in parallel, improving performance by processing these tensors simultaneously. This Op will be based on A…
-
We have an error when we run the model with sharding overrides.
Here, we run simple MNIST benchmark model with passed sharding overrides through the tt-forge-fe. All configurations/overrides are hard…
-
### Description
1) Replace the usage of `ShardUIdAndIndex` with `ShardInfo`
2) Rename `get_prev_shard_ids` and `get_prev_shard_id` to `_infos` and `_info`
-
When a git repository is cached, shards should use that and only that with `--local` (no network requests). This does not seem to work, however. The cache contains bare repositories (only the git meta…
-
### System Info
```
2024-11-06T04:38:58.950145Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.80.1
Commit sha: b1f9044d6cf082423a517cf9a6a…
-
## Is your feature request related to a problem? Please describe.
I'm always frustrated when I'm looking at the storage node config:
```
storage:
shard:
0:
blobstor:
- path: /…
-
**Description**
It would be nice to allow viewing the shards view in a different way where the columns would be the nodes and the rows the indices.
Would be ideal if we could switch between the …
qury updated
2 months ago
-
* Loading a block / chunk currently opens a Filehandle per block which is expensive on some backends (e.g. s3)
* for sharded backends this is bad because several chunks live in the same file
*…
-
Hello everyone,
I'm facing issues with restoring backups using Altinity/clickhouse-backup. The first issue involves a full backup from May/24. This backup contains both the shadow and metadata dire…
-
I'm using code similar to the 8-way batch data parallelism example here: https://jax.readthedocs.io/en/latest/notebooks/Distributed_arrays_and_automatic_parallelization.html#way-batch-data-parallelism…