-
**Use case**
To know which part of the query consumed memory.
**Describe the solution you'd like**
`IProcessor::work` will store the processor name into a thread-local variable.
The query-le…
-
### Motivation.
Each decoding step inside LLMEngine does the following: schedules the sequences to be executed in the next iteration, executes the model and process model outputs.
GPU remains larg…
-
### 🔖 Need
[BEPs](https://github.com/backstage/backstage/tree/master/beps) have been a part of our process in the project for a little while now. I find it to be fairly successful in discussing work …
-
`JPathToken` doesn't seem to handle the escape-character/escape sequence.
For example, `JPathToken` cannot process `$.store.book['o\'clock']`
Some basic escape characters may need to be handle h…
-
# Process Layout
BD0 takes a unique approach to multiprocessing environments and requires unique considerations about process layout.
This RFC aims to tackle only process layout, future RFCs will …
-
### Motivation.
Currently, the OpenAI API server and AsyncLLMEngine share the same asyncio event loop. This means that the API server and the CPU components of the AsyncLLMEngine contend for the same…
-
### About Me
This RFC is posted on behalf of the BBC
### Use Case
We want the blueprints to own the configuration of the system.
For a MOS gateway, the ID of the gateway is defined at the root l…
-
### About Me
This RFC is posted on behalf of the BBC.
### Use Case
This is intended to be a UI/UX continuation of the [RFC: Override NRCS Data in the Sofie GUI](https://github.com/nrkno/sofie-core/…
-
### Problem statement
Currently, there are different implementations of search processors/ingest processors that use a machine learning model, e.g, [TextEmbeddingProcessor](https://github.com/opens…
-
### Proposed solution 🟢
Proposing some updates to the release scripts to reduce manual action and human error:
- Step 1: Prepare the release. Combines the following steps into a single comma…