-
## Information
The problem arises in chapter:
* [ ] Introduction
* [ ] Text Classification
* [ ] Transformer Anatomy
* [ ] Multilingual Named Entity Recognition
* [ ] Text Generation
* [ ] …
-
All possible Generative AI information can be put here
```mermaid
flowchart LR;
prompts --> LLM
```
Some useful links:
- https://learn.microsoft.com/en-us/dotnet/ai/conceptual/how-genai-and-…
-
I'm wondering if there is a plan to deploy on ANE
https://machinelearning.apple.com/research/neural-engine-transformers
This year at WWDC 2022, Apple is making available an open-source referenc…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I'm trying to load an embedding model from HuggingFace on multiple available GPUs using …
-
我在本地运行 cli_demo.py 时出现如下错误:
init model ...
**A matching Triton is not available, some optimizations will not be enabled.
Error caught was: DLL load failed while importing libtriton: 找不到指定的模块。**
…
-
### Feature request
https://arxiv.org/pdf/2404.02827.pdf
Memory efficient optimizer like galore but with less hyperparameters
### Motivation
https://github.com/hiyouga/LLaMA-Factory/pull/3287
…
-
## Information
The problem arises in chapter:
* [ ] Introduction
* [ ] Text Classification
* [ ] Transformer Anatomy
* [ ] Multilingual Named Entity Recognition
* [ ] Text Generation
* [ ] …
-
cuda: 11.7
torch: 2.0.1
python: 3.10.9
release: flash_attn-2.3.5+cu117torch2.0cxx11abiFALSE-cp310-cp310-linux_x86_64.whl
```
File "/home/.conda/envs/venv310/lib/python3.10/site-packages/transfo…
-
jetson@ubuntu:~$ jetson-containers run $(autotag nano_llm) python3 -m nano_llm.chat --api=mlc --model Efficient-Large-Model/VILA1.5-3b --max-context-len 256 --max-new-tokens 32 --pro…
-
https://arxiv.org/abs/2002.11794