-
How can I use the newly release models from meta with Ollama?
https://huggingface.co/collections/facebook/llm-compiler-667c5b05557fe99a9edd25cb
Thanks.
-
Issue to gather issues, task for large models, such as
- flatbuffer size > 2G
- quantize < 8 bit
- ...
---
- support 4bit weights: #12717
- quantize with fake-quantize: #12738
- end-to-end …
-
I found this weird quirk of the Compose compiler. When declaring an unstable class in one module:
```
data class UnstableDataClass(var text: String)
```
(confirmed that it is really unstable:
…
-
With ANN search, we accept giving up accuracy for speed. Since most of the code in [jvector_simd.c](https://github.com/jbellis/jvector/blob/main/jvector-native/src/main/c/jvector_simd.c) deals in floa…
-
## Description
We need to implement a testing framework for the TensorFlow XLA (Accelerated Linear Algebra) compiler model. This framework should comprehensively test the XLA compiler, ensuring it …
-
MWE:
```julia
using Enzyme: Enzyme
using LinearAlgebra: Diagonal, transpose
using Turing: Turing
Turing.@model function demo(x=transpose([1.5 2.0;]))
m ~ Turing.MvNormal(Diagonal([1.0, 1.0…
-
Using the README.md on Ubuntu, I cannot figure out how to build "model-compiler".
Using `cmake -G Ninja -DCMAKE_BUILD_TYPE=Debug ../glow` and `ninja all`, my /bin folder only contain: `InstrGen Node…
-
Does ace-compiler support current large language models such as BERT? Thank you.
-
### Describe the bug
Consider the following code:
```
import "@typespec/http";
using TypeSpec.Http;
model GenericListOKResponse {
...OkResponse;
@header contentType: "application/…
-
### Describe the bug
When using `cc` as compiler, it's not detected during compilation using [Conditional compilation/Compile time code](https://docs.vlang.io/conditional-compilation.html#compile-t…