Closed damNull closed 5 years ago
Thanks for your report! I will look it.
Seems the problem only occurs on windows. I test the code on AWS K80 instance. Its performance is normal as expected.
Currently, MobulaOP uses MXTVMBridge
to implement asynchronous execution, however it doesn't support on Windows, because of the ABI problem
I disable asynchronous execution mode defaultly on Windows. https://github.com/wkcn/MobulaOP/blob/master/mobula/build_utils.py#L45
If the compiler which builds MXNet is the same as that building MobulaOP, it is available to enable the flag USING_ASYNC_EXEC
manually.
I will fix the issue when MXNet provides CPackedFunc
API.
Thanks : )
I wrote my first demo of Mobula op. The directory of my project:
The content of files: main.py:
TestOP.cpp:
time cost: cpu 14s, gpu 226s on i7-7700k & 1080ti. The usage of cpu and gpu is both 100% os environment: win10 1809, cuda 10.0