search

nod-ai / SHARK-Studio

SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution
Apache License 2.0
1.42k stars 172 forks source link

SHARK API #2171

Open gpetters-amd opened 1 month ago

gpetters-amd commented 1 month ago

This is the first step toward the SHARK refactor, right now it's just a skeleton but once I'm sure this is what we're going for I can add in the model complilation code (that's mostly going to be ported from Turbine) and get SD2 working soon.

monorimet commented 1 month ago

@gpetters-amd FWIW the existing api file in apps/shark_studio/api/sd.py can be converted to apps/shark_studio/api/turbine-models-sd.py (that's sort of what you have going at the moment, I think) and refactored to match an abstracted API established in this PR. That way we don't lose the idea you had of an inference engine-agnostic interface to the Studio WebUI.