-
sorry this feels very draft status. move it into a another PR before merging this one
_Originally posted by @mashehu in https://github.com/nf-core/modules/pull/6286#discussion_r184690…
-
-
Hi,
In https://github.com/rails/solid_queue/pull/56 it seems built in support for database sharding was added to solid_queue.
In my team we were unsuccessful in testing this feature. Maybe we a…
-
**Description:**
Hi ,torchrec team,
I'm using EmbeddingCollection and constrain the sharding type as DATA_PARALLEL. Subsequently, I should be able to get the parameters and pass it to my optimizers…
-
**Describe the bug**
1d and 2d matmuls support padding in their outputs e.g. N does not need to exactly divide into tiles and cores. dram-sharded matmuls have some of the code for padding support but …
-
1. The API for shardingDefinition and shardingLifeCycleAction was introduced in 1.0, however shardingLifeCycleAction has not been implemented yet, including sharding preterminate, postprovision, shard…
-
misc/test_sharded.py , untilize, tilize, reduce tests not working.
untilize, tilize llk issues,
reduce need to find out more
-
While reading some unrelated code, I noticed that we write aux keys to all shards. Apparently, they should only be on shard 0.
I checked out the code prior to my sharded ingest work and believe that h…
-
This import is failing with the latest transformers version:
https://github.com/NetEase-FuXi/EETQ/blob/81e0b14d64088d58ef6acd2c8f3e788d59324407/python/eetq/models/base.py#L13
I checked how other…
-
**Describe the bug**
PR #544 adds support for using Oxia as the metadata store for Pulsar and BookKeeper.
When specifying an Oxia cluster with 3 pods, it fails to become available.
**To Reprodu…