dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
2.09k stars 435 forks source link

Few tune for JP 6 #347

Open jasl opened 8 months ago

jasl commented 8 months ago

This PR is not intended to be merged but shows what I've done to make sd-webui work again on JP6.

Contains:

I still see non-blocking issues:

I don't see this on x86 Ubuntu 22.04

/usr/local/lib/python3.10/dist-packages/numba/np/ufunc/parallel.py:371: NumbaWarning: The TBB threading layer requires TBB version 2021 update 6 or later i.e., TBB_INTERFACE_VERSION >= 12060. Found TBB_INTERFACE_VERSION = 12050. The TBB threading layer is disabled.

This seems an existing TensorFlow issue https://github.com/tensorflow/tensorflow/issues/62075

2023-12-10 03:40:44.390211: E tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:9360] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2023-12-10 03:40:44.390290: E tensorflow/compiler/xla/stream_executor/cuda/cuda_fft.cc:609] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2023-12-10 03:40:44.390324: E tensorflow/compiler/xla/stream_executor/cuda/cuda_blas.cc:1537] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered

This branch is based on my previous PR https://github.com/dusty-nv/jetson-containers/pull/310, and I added sd-next. It is a fork of sd-web-ui, which is very stable on API usage, sd-web-ui API often crashes.