Nvidia Jetson tensorflow version -- mismatch

autorope / donkeycar

Open source hardware and software platform to build a small scale self driving car.

http://www.donkeycar.com

MIT License

3.17k stars 1.3k forks source link

Nvidia Jetson tensorflow version -- mismatch #1101

Open Ahrovan opened 1 year ago

Ahrovan commented 1 year ago

According to the installation doc for Nvidia Jetson, will be installed tensorflow==2.3.1
According to the installation doc for Host PC ubuntu, will be installed tensorflow==2.2.0

After creating the model in Host and move it to Jetson, the following error is displayed:

File "/home/ahrovan/env2/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 6843, in raise_from_not_ok_status
six.raise_from(core._status_to_exception(e.code, message), None)
File "<string>", line 3, in raise_from
tensorflow.python.framework.errors_impl.InvalidArgumentError: Matrix size-incompatible: In[0]: [1,67712], In[1]: [6656,100] [Op:MatMul]

But when the model is trained in Jetson. Runs without problems.

Why are different versions of Tensorflow incompatible? And if they do not match. Why these versions not corrected in the documents?

Ahrovan commented 1 year ago

@DocGarbanzo Is this problem related to tensorflow version 2.3.1? tf_2_9 Can be installed and used?

DocGarbanzo commented 1 year ago

@Ahrovan - can you check that you have the same image setting on your trained model as well as on your robot. I.e. IMAGE_W, IMAGE_H in your myconfig.py? The tf_2_9 branch will be merged to main soon. Please note, the jetson installation for that will be quite tricky, so please wait until we have published the instructions to the docs, because it's very unlikely you'll get it to work without them.

Ezward commented 1 year ago

ubuntu.yml installs tensorflow 2.2.0, see ubuntu.yml#L39 but Jetson Nano installs 2.3.1, see docs setup_jetson_nano.md#L66

In addition mac.yml installs tensorflow 2.2.0, see mac.yml#L43

Windows docs also shows to install TF 2.2.0, see setup_windows.md#L59 and setup_windows.md#L69

Ahrovan commented 1 year ago

pip install tensorflow==2.3.1 in PC Host env/conda solved. just need test. working on it...

Ezward commented 1 year ago

We have to do a little work here; I think the final fix will be when @DocGarbanzo lands the tensorflow 2.9 branch; then both raspberry pi and jetson nano will use the same version, so we can update the docs to that version.

Ahrovan commented 1 year ago

Please update asap. Thank you

Ezward commented 1 year ago

@Ahrovan you have a workaround, is that correct? I am re-opening; this is a real issue and we appreciate you bringing this up. I will close when the tf 2.9 branch lands.

Ahrovan commented 1 year ago

I have prepared this table. Please note that there may be minor mistakes. One thing is very important. Tensorflow or pytorch user should choose only one. There are many problems in lower versions of JetPack. @Ezward