-
I am trying to use a massive CSV (1M+ rows), with the X input having 400 dimensions. It's technically working but I had two main questions:
1. It seems like the GPU is bottlenecked a bit by the CP…
-
I saw the cpu usage rate 100% and gpu usage rate 16% on win10's Task Manager ,when i training model.
does it mean that i use cpu not gpu?
how can i fix it?
i already used os.environ["CUDA_VISIBLE_…
-
Hi,
Just wondering if aitextgen finetuning supports multi-threading/multi-CPU (parallel/distributed) training. I understand the execution is much faster on GPUs, but in case that GPU is not available…
-
### Describe the issue
Hi,
I have been reading the documentation for ONNX Runtime and came across the RKNPU Execution Provider (EP). I would like to clarify my understanding:
It appears that the …
-
While training I see that the part where the GPU is used is finished very fast in every iteration, but then the part where the CPU is used takes rather long. This leads to a very strong bottleneck whe…
-
When training an index the shuffling stage runs too slowly. This seems to be because we are storing 1 batch per partition (even empty partitions need a batch) and there is a lot of concatenation. By…
-
Do you support ONNX export and is it tested? Any examples of it would be appreciated.
-
The cpu memory usage is high when training on Cityscapes. I didn't crop the image, and input size is 1024x2048. Larger size may lead to higher GPU memory usage but my GPU memory usage is okay(around 1…
-
**Alluxio Version:**
2.9.3
**Describe the bug**
I use alluxio in tensorflow training situation to replace the CephFS(Source data are in HDFS). And I found that when I used more dataset reading th…
-
Hello,
I had a problem when I did the multi-sample binning. The error information is below,
2024-05-28 00:44:40 localhost.localdomain SemiBin[102770] INFO Setting number of CPUs to 64
2024-05-…