-
Hello,
I am a computational linguist working on an exciting project regarding NLP and machine translation.
Custom logits processors and, thereby, constrained decoding are of high interest to me,…
-
- [x] explore options for mapping out sys arch
- [x] explore tools: mkdocs, markmap in VS Code
- [x] prep Github Page for docs hosting
- [x] visually represent the ideal RSC as a mindmap
- [x] note &…
mbz4 updated
2 months ago
-
-
- Delete responses from a conversation, or even aspects of a response. This will help improve the quality of the data being stored in the index... many conversations result in unusable outputs, mislea…
-
**Is your feature request related to a problem? Please describe.**
vLLM backend works well and is easy to set up, compared to TensorRT which had me pulling my hair.
However it lacks the OpenAI co…
-
- [ ] [Amazon bedrock plugin for llm cli](https://github.com/sblakey/llm-bedrock-anthropic)
# Amazon bedrock plugin for llm cli
**Description:** Plugin for LLM adding support for Anthropic's Claude…
-
I am trying to change the environment to Ollama in Danswer, However, I am encountering an issue where it still requests an OpenAPI key. This issue persists despite multiple attempts to resolve it.
…
-
### 🚀 Feature
We currently have a few settings for 4bit and 8bit quantization hard-coded
```python
load_in_8bit=True,
llm_int8_threshold=0.0,
```
```python
…
-
There is two options here:
1. Either using [OpenAI's fine-tuning API](https://platform.openai.com/docs/guides/fine-tuning), which might be easier to implement, but it might give us less flexibility…
-
### Details
_No response_
Checklist
- [X] ``main.py`` ✅ Commit [`521d091`](https://github.com/qa-tools-family/data-center-for-qa-llm/commit/521d09155f93f22be80775d3aff42f6c6531f363)