nod-ai SHARK-Platform issues

nod-ai / SHARK-Platform

SHARK Inference Modeling and Serving

Apache License 2.0

9 stars 19 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Draft a shark-platform meta package to organize Python packages.

#244 ScottTodd opened 7 minutes ago
0
Add new access token for release publishing.

#243 ScottTodd closed 4 hours ago
0
[tuner] Update tuner lowering_config setting

#242 Groverkss opened 6 hours ago
3
[shortfin] Fix mobilenet_server example by writing bytes directly.

#241 ScottTodd opened 23 hours ago
0
[shortfin] Add extras_require for optional deps.

#240 ScottTodd opened 1 day ago
4
[shortfin] Add model build system.

#239 stellaraccident closed 4 days ago
0
[libshortfin] Add workflow to build nightly packages.

#238 ScottTodd closed 1 day ago
0
WIP Make sharded Llama export test also compile to IREE module

#237 sogartar opened 5 days ago
1
Remove xfail from sharded Llama export to MLIR test

#236 sogartar closed 5 days ago
0
[shortfin] Update README

#235 marbre closed 5 days ago
0
[shortfin] Refactor to avoid changing directories

#234 marbre closed 5 days ago
0
[sharktank] Evaluation - Add Perplexity test

#233 archana-ramalingam opened 5 days ago
0
Rename libshortfin -> shortfin.

#232 stellaraccident closed 5 days ago
0
Move the old shortfin serving code to sharktank.serving_poc.

#231 stellaraccident closed 5 days ago
0
[libshortfin] Add package build script for Linux using manylinux.

#230 ScottTodd closed 1 day ago
0
[shortfin] Make system construction selectable by type name.

#229 stellaraccident closed 5 days ago
0
Disable static rotary tables

#228 rsuderman closed 5 days ago
0
[libshortfin] Fix `SHORTFIN_ENABLE_TRACING` typo.

#227 ScottTodd closed 6 days ago
0
[shortfin] Fix issues with free threaded Python builds.

#226 stellaraccident closed 6 days ago
0
[libshortfin] Re-land "Fix standalone Python package build to include subpackages."

#225 ScottTodd closed 6 days ago
0
Revert "[libshortfin] Fix standalone Python package build to include subpackages."

#224 ScottTodd closed 6 days ago
0
[libshortfin] Fix standalone Python package build to include subpackages.

#223 ScottTodd closed 6 days ago
0
[libshortfin][rtd] Build libshortfin with GCC

#222 marbre closed 6 days ago
0
[libshortfin] Build fixes for gcc 12.3.0 and 13.2.0.

#221 ScottTodd closed 6 days ago
0
Add test that exports to MLIR a small sharded Llama model

#220 sogartar closed 5 days ago
5
[libshortfin] Add a workflow with disabled GIL

#219 marbre closed 6 days ago
0
Cancel in-progress runs for the same PR or commit

#218 marbre closed 6 days ago
0
[libshortfin] Add additional auto documentation

#217 marbre closed 6 days ago
0
[libshortfin] AMDGPU configuration settings.

#216 stellaraccident closed 6 days ago
0
Issue building libshortfin with GCC

#215 marbre closed 6 days ago
0
Set linking mode to static by default on Windows.

#214 ScottTodd closed 1 week ago
0
[libshortfin] Add a .readthedocs.yaml

#213 marbre closed 1 week ago
2
[libshortfin] Implement multi-device CPU system config.

#212 stellaraccident closed 6 days ago
0
Issues building libshortfin on Windows with `-DSHORTFIN_BUILD_DYNAMIC=ON`

#211 ScottTodd opened 1 week ago
1
Build fixes for libshortfin using Windows/MSVC.

#210 ScottTodd opened 1 week ago
0
[libshortfin] Enable building docs with Sphinx

#209 marbre closed 1 week ago
0
Update Flash Attention Custom Op Template MLIR

#208 saienduri closed 1 week ago
0
[NFC] Rename shortfin Scope -> Fiber.

#207 stellaraccident closed 1 week ago
0
[shortfin] Add argmax host op.

#206 stellaraccident closed 1 week ago
2
[shortfin] Fix nd array view indexing bug.

#205 stellaraccident closed 1 week ago
0
[shortfin] Add xtensor support for float16.

#204 stellaraccident closed 1 week ago
0
[libshortfin] Rework array mapping python bindings.

#203 stellaraccident closed 1 week ago
0
[punet] Add support to export fp8 punet variant

#202 nithinsubbiah opened 1 week ago
0
[libshortfin] Add missing scheduler dependency.

#201 stellaraccident closed 1 week ago
0
Implement einstein summation notation kernel for 2 input arguments

#200 KyleHerndon closed 23 hours ago
0
Prefill tests for llama 2 7b and llama 3.1 8b

#199 aviator19941 opened 1 week ago
0
[libshortfin] Rollup of API changes and fixes to support the LLM server.

#198 stellaraccident closed 1 week ago
0
[libshortfin] Move the logging setup

#197 pashu123 closed 1 week ago
1
[libshortfin] Add device_array.items

#196 Groverkss closed 1 week ago
0
[libshortfin] Fix python stub generation.

#195 stellaraccident closed 2 weeks ago
1