Currently compilations happen on the main application thread: This can be a latency impact. A great way to work around this is to do the compilation on a dedicated thread.
We can maybe take some inspiration from Charlie Gracie's work on on doing asynchronous compilation in SOM++:
Currently compilations happen on the main application thread: This can be a latency impact. A great way to work around this is to do the compilation on a dedicated thread.
We can maybe take some inspiration from Charlie Gracie's work on on doing asynchronous compilation in SOM++:
https://github.com/charliegracie/SOMpp/blob/omr_jitbuilder/src/vm/Universe.cpp#L322