-
Any ideas for providing LLM observalibility options from frameworks like LangChain?
A simple approach (given OpenTelemetry integration) could be to use openllmetry. More details on a SDK for itneg…
-
Hi,
This notebook is awesome. I have a question, what if the model I want to deploy is not the [sentence-transformers list](https://huggingface.co/models?library=sentence-transformers&sort=trending…
-
# Learn by Blogging - The Mental Model for Leveraging LLMs in Cloud
In this blog post, we are exploring the intersection of different sized LLMs and their optimal compute environments for deployment
…
-
**Inference:**
```bash
CUDA_VISIBLE_DEVICES=0 swift infer --model_type got-ocr2 --model_id_or_path stepfun-ai/GOT-OCR2_0
```
```
-
I am using azureopenai and an error occurs when I run it
```
EMBEDDING_PROVIDER = "azureopenai"
LLM_PROVIDER = "azureopenai"
AZURE_EMBEDDING_MODEL= "text-embedding-ada-002"
SMART_LLM_MODEL =…
-
THIS IS NOT OPEN SOURCED PLEASE ALLOW US TO USE 7b models!!!
-
Hi team, first of all thanks for this great repo for showcasing how to leverage the latest techniques in torch ecosystem, it's been super useful and insightful :) I have a naive question about FP8 opt…
-
**Title of the talk/workshop**
The Guide to Building Open Indic LLMs Today
**Abstract of the talk/workshop**
- Steps in training modern LLMs
- Challenges specific to Indic Models (Tokeni…
-
New [InternVL-Chat-V1.5](https://github.com/OpenGVLab/InternVL) just came out, and the quality is really great, and the benchmark score is pretty high too. Possibly best open source vision language mo…
-
I really appreciate your contribution and dedication to advancing large-scale language modeling in Japanese.
Would you kindly provide the bibliographic infromation of the JP Language Model Evaluati…