-
When training an index the shuffling stage runs too slowly. This seems to be because we are storing 1 batch per partition (even empty partitions need a batch) and there is a lot of concatenation. By…
-
Hi,
Just wondering if aitextgen finetuning supports multi-threading/multi-CPU (parallel/distributed) training. I understand the execution is much faster on GPUs, but in case that GPU is not available…
-
When running the Falcon7B MLP (input-host-to-device + forward-pass + output-device-to-host) on galaxy in a loop of 10000 iterations, the loop occasionally pauses (i.e. freezes, but does not hang and r…
-
I am trying to use a massive CSV (1M+ rows), with the X input having 400 dimensions. It's technically working but I had two main questions:
1. It seems like the GPU is bottlenecked a bit by the CP…
-
I saw the cpu usage rate 100% and gpu usage rate 16% on win10's Task Manager ,when i training model.
does it mean that i use cpu not gpu?
how can i fix it?
i already used os.environ["CUDA_VISIBLE_…
-
So, the error message is completely accurate. The score files in the "predict_results" folder are all zero bytes, but it doesn't give me an idea why.
first 1000 lines of log (with the SVision call)…
-
Hello
I am trying to run the code:
SemiBin2 single_easy_bin -i assembly/megahit/coassembly/coassembly.contigs_renamed.fa -b mapping/bam/cobinning/*.sorted.bam -o binning/Semibin2
I think the…
-
Hello,
I had a problem when I did the multi-sample binning. The error information is below,
2024-05-28 00:44:40 localhost.localdomain SemiBin[102770] INFO Setting number of CPUs to 64
2024-05-…
-
Do you support ONNX export and is it tested? Any examples of it would be appreciated.
-
I'm training a binary classification model on a dataset which comprised of roughly several millon samples, each containing tens of thousands of numerical features, relatively sparse though. After few …