ESP-DL tutorial/tvm_example No module named 'tvm.relay.op.contrib.esp' (IDFGH-12113) (AIV-678)

MarkMendelsohn commented 4 months ago

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

IDF version.

5.0

Operating System used.

Linux

How did you build your project?

Command line with Make

If you are using Windows, please specify command line type.

None

What is the expected behavior?

successful build

What is the actual behavior?

esp-dl/tutorial/tvm_example$ . ./script.sh Collecting tensor data and making histogram ... Finding optimal threshold for each tensor using entropy algorithm ... Number of tensors : 25 Number of histogram bins : 128 (The number may increase depends on the data it collects) Number of quantized bins : 128 WARNING:root:Please use QuantFormat.QDQ for activation type QInt8 and weight type QInt8. Or it will lead to bad performance on x64. Traceback (most recent call last): File "../../tools/tvm/export_onnx_model.py", line 11, in from tvm.relay.op.contrib.esp import preprocess_onnx_for_esp, evaluate_onnx_for_esp ModuleNotFoundError: No module named 'tvm.relay.op.contrib.esp'

Steps to reproduce.

cd esp-dl/tutorial/tvm_example

. ./script.sh

Build or installation Logs.

esp-dl/tutorial/tvm_example$ . ./script.sh 
Collecting tensor data and making histogram ...
Finding optimal threshold for each tensor using entropy algorithm ...
Number of tensors : 25
Number of histogram bins : 128 (The number may increase depends on the data it collects)
Number of quantized bins : 128
WARNING:root:Please use QuantFormat.QDQ for activation type QInt8 and weight type QInt8. Or it will lead to bad performance on x64.
Traceback (most recent call last):
  File "../../tools/tvm/export_onnx_model.py", line 11, in <module>
    from tvm.relay.op.contrib.esp import preprocess_onnx_for_esp, evaluate_onnx_for_esp
ModuleNotFoundError: No module named 'tvm.relay.op.contrib.esp'

More Information.

Also tried on Mac Intel, M1 and M2 and Windows 11

MarkMendelsohn commented 4 months ago

Working on Linux now, but not the other platforms.

the downloads.sh only seems to get libtvm.so files for Linux but not libtvm.dylib files for the Mac

BlueSkyB commented 4 months ago

You can refer to the following link for details: https://docs.espressif.com/projects/esp-dl/en/latest/esp32s3/tutorials/deploying-models-through-tvm.html#set-tvm-package-path

Check if the PYTHONPATH environment variable is set to the correct value, ensuring that the path matches the local tvm/python folder path (export PYTHONPATH=$PYTHONPATH:/path-to-esp-dl/esp-dl/tools/tvm/python).

MarkMendelsohn commented 4 months ago

On Ubuntu, the following output is produced:

esp-dl/tutorial/tvm_example$ . ./script.sh Collecting tensor data and making histogram ... Finding optimal threshold for each tensor using entropy algorithm ... Number of tensors : 25 Number of histogram bins : 128 (The number may increase depends on the data it collects) Number of quantized bins : 128 WARNING:root:Please use QuantFormat.QDQ for activation type QInt8 and weight type QInt8. Or it will lead to bad performance on x64. Model Information:

Input Name: input_1 Input Shape: (1, 32, 32, 3) Input DType: float Output Name: Identity Output Shape: (1, 10) Output DType: float One or more operators have not been tuned. Please tune your model for better performance. Use DEBUG logging level to see more details. esp_dl_library_path: /media/mpm/FiveTDrive/esp-dl generated project in: ./new_project

The environment variable is set: $ env | grep PY PYTHONPATH=/media/mpm/FiveTDrive/esp-dl/tools/tvm/python

Also:

esp-dl/tools/tvm/python/tvm$ file *.so libtvm_runtime.so: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, BuildID[sha1]=b282dcf2103ca41ed42da59b5cab959277d8cac6, with debug_info, not stripped libtvm.so: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, BuildID[sha1]=c635d10c85e10f342ea6b2d48de8b8056125536b, with debug_info, not stripped

On the MAC:

RuntimeError: Cannot find libraries: ['libtvm.dylib', 'libtvm_runtime.dylib'

There or no libraries by this name on the MAC and the .so libraries are not compatible with this platform

BlueSkyB commented 4 months ago

Your previous error was: “ModuleNotFoundError: No module named 'tvm.relay.op.contrib.esp'.” So, has your problem been resolved on the Ubuntu platform? Currently, it is not supported on macOS platform.

espressif / esp-dl