search

Wikidata / soweego

Link Wikidata items to large catalogs
https://meta.wikimedia.org/wiki/Grants:Project/Hjfocs/soweego_2
GNU General Public License v3.0
95 stars 8 forks source link

Dependencies update #384

Closed MaxFrax closed 4 years ago

MaxFrax commented 4 years ago

Updates all the dependencies to the latest version possible. I have run all the pipeline with success with the dependencies updated. Closes also #380

marfox commented 4 years ago

I'm on the prod VPS. If I run:

$ ./docker/prod.sh
root@ff0fb7a4a2db:/app/soweego# python -m soweego

I get unrelevant tensorflow warnings:

2020-03-18 18:48:04.450180: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer.so.6'; dlerror: libnvinfer.so.6: cannot open shared object file:
 No such file or directory                                    
2020-03-18 18:48:04.452246: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer_plugin.so.6'; dlerror: libnvinfer_plugin.so.6: cannot open share
d object file: No such file or directory     
2020-03-18 18:48:04.452284: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.

We should definitely silence them.

marfox commented 4 years ago

We should also keep an eye on https://www.tensorflow.org/guide/migrate

marfox commented 4 years ago

IMPORTANT: we gave up switching from keras to tensorflow.keras, since we're hitting an open tensorflow issue, see efd8f62ad9ff5432ae66a514c27c5cc6fcdc7433

This PR introduces the following modifications: