-
When using image volume mounts it looks like that cri-o expects the mounted image to be of the same OS architecture as the running container runtime. Using the example from #8780, and don't having an …
rhuss updated
13 hours ago
-
### Name and Version
./llama-cli --version
version: 4077 (af148c93)
built with Apple clang version 15.0.0 (clang-1500.3.9.4) for arm64-apple-darwin23.6.0
### Operating systems
Mac
### W…
-
### System Info
System:
- CPU Architecture: x86_64
- GPU: NVIDIA H100 - 80GB - CUDA 12.4
- TensorRT-LLM: main branch, commit 535c9cc6730f5ac999e4b1cb621402b58138f819
- Operating System: Ubuntu 22.04…
-
When trying to run any Llama model (such as https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF), text generation only outputs ``.
Here is the output when running `cargo run --release --bin…
-
[rank0]: Traceback (most recent call last):
[rank0]: File "/data/chuzuowei/chem/Vary-main/MU-GOT/pdf2txt.py", line 1, in
[rank0]: from PDF_parsing import pdf2md, vllm_got, process_md
[rank0]…
-
When I quantified the Qwen2.5-1.5B-instruct model according to **"Quantizing the GGUF with AWQ Scale"** of [docs](https://qwen.readthedocs.io/en/latest/quantization/llama.cpp.html) , it showed that th…
-
### Is your feature request related to a problem? Please describe.
To build confidence in JB Manager architecture. We need to stress test the architecture.
### Describe the solution you'd like
We …
-
Potential Data Format that gives courses to take and reasoning. Will be replace with LPI Dataset courses/infoy
input: I want to learn about llm and how to finetune them. I\'m intermediate and i …
-
### Is your feature request related to a problem or challenge?
LLMs provide a fantastic way to learn and use a new codebase. By providing the documentation, they can create a custom guide for new use…
-
### Discussed in https://github.com/langchain-ai/langchain/discussions/27404
Originally posted by **kodychik** October 16, 2024
### Checked
- [X] I searched existing ideas and did not find …