Updated mistral additions with examples (removing abstraction) as it caused some unnecessary complexities. also a big note on the constructor for our ModelsDownloadsController:
private constructor() {
this.models = new Pieces.ModelsApi().modelsSnapshot();
this.models.then((models) => {
this.initSockets(
models.iterable.filter(
(el) =>
// this filter is important and defines what possible websockets will be initialized and included in the filtered list.
(el.foundation === Pieces.ModelFoundationEnum.Llama27B || el.foundation === Pieces.ModelFoundationEnum.Mistral7B ) &&
el.unique !== 'llama-2-7b-chat.ggmlv3.q4_K_M'
)
);
});
}
This filter can completely block the visibility of a model as the Web Socket will never initialize.
Updated mistral additions with examples (removing abstraction) as it caused some unnecessary complexities. also a big note on the constructor for our
ModelsDownloadsController
:This filter can completely block the visibility of a model as the Web Socket will never initialize.