Closed Sajtospoga01 closed 2 months ago
The model_path
should refer to a saved torchscript roberta model. Is that so?
Yes, though the runtime crashes on the line var session = engine.InferenceSession()
. I changed the path afterwards however the issue remains the same, it works with just in time but does not work when first built then executed.
So the way it works: either:
mojo helloworld.mojo
or
mojo run helloworld.mojo
what does not work:
mojo build helloworld.mojo
then
./helloworld
Thanks for reporting! We are looking into this.
Out of curiosity @Sajtospoga01 -- does this issue persist with the latest v24.2 build (modular update max && modular update mojo
)?
Yes, I just updated it to the latest version, and I am encountering the same error.
@Sajtospoga01 - are you able to try 24.4 and see if this is still occurring and re-open if it is? Thanks
Hi @iamtimdavis, Sorry for getting back so late, I just checked the release and it seems to be working good, thank you for the fix 🙂
Bug description
After compiling the mojo code, I receive an error: 'Assertion `runtime && "no runtime is associated with the current thread"' failed' from: /__w/modular/modular/LLCL/include/LLCL/Runtime/Runtime.h:82
This error only happens if the project is compiled(with
mojo build helloworld.mojo
), and not when just in time executed.Steps to reproduce
The simple code i head (from the docs site, and it crashes at creating the engine.inferencesession())
The command line out:
There are no further steps done.
System information