search

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.
https://dot.net/ml
MIT License
9.05k stars 1.88k forks source link

support for aot (ahead of time) to deal with ml.net models #6942

Open NofAssiri opened 10 months ago

NofAssiri commented 10 months ago

is there api to load ml.net model and predict with no dynamic code generation (reflection)?

Describe the solution you'd like ml.net api that is compatible with aot principles.

michaelgsharp commented 10 months ago

Currently we are not AOT compatible, though this is something we have talked about looking into.

@luisquintanilla is this something we are thinking about doing still? Or is it further back in our backlog?

luisquintanilla commented 10 months ago

Thanks for this suggestion @NofAssiri. Could you please provide additional details about your use case.

is this something we are thinking about doing still? Or is it further back in our backlog?

I think we still need to understand what the cost / benefits of this are and get more feedback around scenarios. At this time, there are no immediate plans for this work and is further back in our backlog.

FrancescoCarraro commented 6 months ago

my 2 cents. It seems to me benefits of AOT are clear: computational time is very different and this is extremely important in some scenarios. I'm currently working on a couple of apps (a console app and a MAUI app) for being used in scientific analysis and having ML.NET compatible with AOT compilation would be really great to have shorter waitings for results. I really hope you would implement AOT support!