microsoft onnxruntime-genai issues

microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime

MIT License

157 stars 41 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

make graph capture apis easy to understand

#472 wangyems opened 6 hours ago
6
Bump gradio from 3.42.0 to 4.19.2 in /examples/chat_app

#471 dependabot[bot] closed 8 hours ago
2
Cherry-pick for rel 0.2.0

#470 yufenglee opened 10 hours ago
0
Update DML to 1.14.2 and remove workaround

#469 PatriceVignola closed 10 hours ago
0
Drop std::filesystem for custom file path handling

#468 skyline75489 opened 18 hours ago
0
Add custom DML allocators and non-global env to work around memory issues

#467 PatriceVignola closed 8 hours ago
3
Update README and add Python package description

#466 natke closed 5 hours ago
0
hotfix max length benchmark script

#465 aciddelgado closed 11 hours ago
0
Support extra inputs in graph captures

#464 PatriceVignola closed 1 day ago
0
Feature Request: Specify seed in python SDK

#463 Ben-Epstein opened 2 days ago
0
Model for llama-3-8B, EP: cpu, precision: int4 generated using onnxruntime-genai/src/python/py/models/builder.py has issues

#462 jmopuri opened 2 days ago
3
[DRAFT] Initial Java bindings.

#461 skottmckay opened 2 days ago
0
benchmark multiple models and parameters at once

#460 aciddelgado closed 2 days ago
0
Gemma-2b-it EP:CPU int4 ONNX model generated using ONNXruntime-genai throws an error

#459 jmopuri-Intel closed 2 days ago
4
Include vector

#458 baijumeswani closed 10 hours ago
0
cherry-pick for official 0.2.0

#457 baijumeswani closed 10 hours ago
1
Set PUBLIC_HEADER DESTINATION to include

#456 jchen351 closed 3 days ago
0
add LLM chat app into ort_genai examples

#455 zhangxiang1993 closed 8 hours ago
0
Extend GeneratorParams.SetSearchOption to allow setting strings

#454 koepalex opened 3 days ago
0
GeneratorParams should not throw an exception

#453 skottmckay opened 3 days ago
1
Wasm/WebGPU backends?

#452 josephrocca opened 3 days ago
1
Enabling Linux Arm64 CI to use ORT nightly

#451 jchen351 closed 2 days ago
0
Regex decoding support

#450 sheepymeh opened 4 days ago
2
Embed ort lib inside ort genai nuget

#449 baijumeswani closed 3 days ago
0
Fix onnxruntime-genai-cuda installation

#448 Tabrizian opened 4 days ago
0
Moving ORT-Genai DLL into lib folder

#447 jchen351 closed 4 days ago
0
How to release GPU memory after each inference?

#446 nguyenthekhoig7 opened 4 days ago
1
Test fix - ensure random indices don't overlap

#445 RyanUnderhill closed 4 days ago
0
Is there a plan to support running Phi3 on the NPU of the Core Ultra

#444 goxia opened 5 days ago
0
Fix typo in build.py to correctly add to the toolset

#443 baijumeswani closed 3 days ago
0
Extensions for LLM

#442 hannespreishuber opened 6 days ago
1
Logging unit tests & C++ API fixes

#441 RyanUnderhill closed 1 week ago
0
Add logging documentation in logging.h

#440 RyanUnderhill closed 1 week ago
0
Rename add_extra_input python API to match C/C++ one

#439 RyanUnderhill closed 1 week ago
0
Fix missing version, lib64 and component governance

#438 jchen351 closed 1 week ago
0
Add ort suffix for DML dependency in packaging pipeline for nuget

#437 baijumeswani closed 1 week ago
0
How to ignore EOS token when using onnxruntime-genai

#436 Tabrizian opened 1 week ago
0
Cherry-pick PR for rel-0.2.0-rc7

#435 baijumeswani closed 4 days ago
0
Cleanup Github CI

#434 jchen351 closed 3 days ago
0
[WIP] standalone shared library for custom op using ORTX-extensions infrastructure

#433 jslhcl opened 1 week ago
0
Fix packed QKV Add after packed QKV MatMul in model builder

#432 kunal-vaishnavi closed 1 week ago
0
Using dotnet CLI to download ORT

#431 jchen351 closed 1 week ago
0
Cannot use the DirectML packages to run on CPU in Windows App

#430 natke opened 1 week ago
5
Remove embedded ort libs from nuget

#429 baijumeswani closed 1 week ago
0
AddExtraInput API for C/C++/C#

#428 RyanUnderhill closed 1 week ago
2
Reduce zip package size and update zip package naming patten

#427 jchen351 closed 1 week ago
0
support for ort-web

#426 guschmue closed 1 week ago
2
OnnxRuntimeGenAIException - OrtValue shape verification failed, when running Phi-3 model with DML

#424 AshD closed 1 week ago
4
Remove label after #endif

#423 RyanUnderhill closed 1 week ago
0
Refacor and decluttering top level Cmakelist.txt

#422 jchen351 closed 1 week ago
0