-
Congratulations on the excellent work!
When training large language models, we generally adopt the gradient checkpointing technique. Could you please help me turn on this technique in your code?
…
-
I'm not familiar with how llamacpp works, but I've heard that some of the context handling work is done exclusively on GPU0. In this connection there is a question: is there any sense to add one more …
-
Hello, congratulations on the successful acceptance of your paper by ICML. We think your work is very interesting. I want to reproduce your code, but the code you provided seems incomplete, the segmen…
wwwlg updated
4 months ago
-
Thank you for your outstanding work, the test results I got after running your test.py file are in the results folder of logs where there are 10 text files, text0, text1, ........ text10. What do I ne…
-
### What is the issue?
I am ruuning a python script traing some model and there is another flask servive binded with ollama.In the script ,I set os.environ["CUDA_VISIBLE_DEVICES"] = "1".I want the fl…
-
**Before you raise a bug**
[] For using this app, I have read and tried solution in mentioned by manual: https://github.com/derekhe/msfs2020-map-enhancement/wiki/Manual-EN
[] For license issue, I …
-
Hey there, I was trying to run test_pose_estimation.py on RTX 3090Ti, but I encountered a RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED. Do you happen to know what could be causing this issu…
-
## Description
I tried to use trtexec to convert the onnx model to engine file but fails with the error below
[04/19/2024-14:04:31] [V] [TRT] =============== Computing costs for /patch_embe…
-
**两人同时访问webui进行提问出现报错**
0.3.1源码部署成功后两人同时访问web进行提问，出现以下报错
**实际结果 / Actual Result**
ERROR: Exception in ASGI application
Traceback (most recent call last):
File "/home/test/.conda/envs/langchain3…
-
**Hi, All**
Is there any option for running batched GEMM on TensorCore with INT1 precision?
I currently notice the example of a float precision batched GEMM without Tensorcore [here](https://githu…