Recent conversations (especially in the machine learning working group) suggest a need for a more specialized version of wasi-nn targeting LLMs. This change proposes such an interface, allowing users to access an ML graph directly using prompt strings instead of through the original tensor-based interface (i.e., inference).
Recent conversations (especially in the machine learning working group) suggest a need for a more specialized version of wasi-nn targeting LLMs. This change proposes such an interface, allowing users to access an ML
graphdirectly using prompt strings instead of through the original tensor-based interface (i.e.,inference).