JetBrains-Research / kinference

Running ONNX models in vanilla Kotlin
Apache License 2.0
155 stars 6 forks source link

Major memory control refactoring #199

Closed dmitriyb closed 2 months ago

dmitriyb commented 3 months ago
  1. Added option for manual array allocation control
  2. Allocator storage refactoring for less memory consumption and faster access
  3. Controlling mechanisms enhanced, including timed cache clearing
  4. Abandoning array wrapper structures in favor of working with raw primitive arrays