JBAI-726 memory management

JetBrains-Research / kinference

Running ONNX models in vanilla Kotlin

Apache License 2.0

158 stars 6 forks source link

Closed dmitriyb closed 8 months ago

dmitriyb commented 9 months ago

ArrayDispatcher allocates and stores arrays of primitive types for all tensors in a centralized manner
Used in the allocation of all tensors through the PrimitiveTileArray constructor
It controls up to 80% of all array allocations
Is not used in dotTransposedWithAlpha in the current version (further investigation required)