-
Atomic-server has been designed to run on low-end hardware, as a self-hosted server. This was why I decided to use an embedded database (sled) and search engine (tantivy).
However, this introduces…
-
Offline a user reported getting `RuntimeError: file metadata is only available after writer close` when writing a Dask DataFrame to parquet with our pyarrow engine. The traceback they were presented w…
-
Model: Qwen-14B-Chat (QWen2)
Dataset: https://huggingface.co/datasets/Hello-SimpleAI/HC3-Chinese/blob/main/open_qa.jsonl
Environment: 2 A30 GPU
Issue 1:
Error: can't init model correctly. Disab…
-
Hi, thank you for the great work!
The current implementation of the `PackedDataset` class only supports in-memory map-style datasets. When working with large datasets, the in-memory limitation can…
-
The following snippet currently fails in Dask-CUDA if we use `protocol="ucx"`:
Reproducer and output
```python
In [1]: from dask_cuda import LocalCUDACluster
...: from dask_cuda.initialize …
-
您好,请问下运行代码时报一下错误,我确认端口是没有被占用的,麻烦您帮忙解答一下哈。我的设置如下:
GPUS_PER_NODE=2
# Change for multinode config
MASTER_ADDR=localhost
MASTER_PORT=8514
NNODES=1
NODE_RANK=0
WORLD_SIZE=$(($GPUS_PER_NODE*$NNODES))…
-
# Metadata for database package
## FathomNet data package description:
### title of the data package that will be archived at NCEI
__Title:__ FathomNet: An open-source image database for trai…
-
### Reproducing the behavior
When running "bend run-c" using "large" arrays in the quicksort example in the repo with theese changes on the main function:
```py
(GetDataset) = [1,2,3...2^19]
#…
-
Thanks for the very helpful repo. I would like to know if there any interface for non-iid data setting for each client?
I don't find it in the src code.
Thanks.
-
Traceback (most recent call last):
File "train.py", line 694, in
main(net, train_datasets, valid_datasets, args)
File "train.py", line 327, in main
train_dataloaders, train_datasets =…