-
Do you have the equivalent simple C implementation of LLM but for inference of LLAMA models.
I am trying to build a FPGA accelerator for LLM and a simple reference C code would be very helpful
Thank…
-
Think about an automatic mechanism in which we can use the feedback we get from the users back in our evaluation dataset.
Use it as part of our dataset ground truth (good or bad )
Tasks
- [ ] D…
-
### Feature Description
When will the bug https://github.com/run-llama/llama_index/issues/15366 will be fixed and released, need yo use it
### Reason
When will the bug https://github.com/run-llama…
-
A Personal NotebookLM and Perplexity-like AI Assistant for Everyone. Research and Never forget anything.
[Github](https://github.com/MODSetter/SurfSense)
Key Features
💡 Idea: Have your own private …
-
# URL
- https://arxiv.org/abs/2408.03314
# Authors
- Charlie Snell
- Jaehoon Lee
- Kelvin Xu
- Aviral Kumar
# Abstract
- Enabling LLMs to improve their outputs by using more test-time comput…
-
### Bug Description
I did the following;
!pip install llama-index
!pip install llama-index-llms-sambanova
### Version
latest
### Steps to Reproduce
just followed LLM example for sambanova
### …
-
**(open-llm-vtuber) PS D:\download\1117\Open-LLM-VTuber> python server.py
INFO: Started server process…
-
I’m not sure if the LLM can handle a different number of visual tokens than what was used during training. If N visual tokens are discarded, is there a step to adjust the dimension before feeding them…
-
**What problem or use case are you trying to solve?**
Create a coding agent that improves itself based on benchmarks. In addition to (potentially) getting better agent performance this will also ena…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hi, I'm using llama-index-bedrock-converse@0.2.2, on CBEventType.LLM, always got `NotImp…