MiraldiLab / maxATAC

Transcription Factor Binding Prediction from ATAC-seq and scATAC-seq with Deep Neural Networks
Apache License 2.0
25 stars 8 forks source link

Error on running predict: could not load dynamic library for tensorflow #115

Open timothykoala opened 1 year ago

timothykoala commented 1 year ago

Hi Tareian, It's me again, after fixed prepare function on samtools and bedGraphToBigWig by reinstallation, the predict function got some "cannot open shared object file: No such file or directory" looping. Got a very unexpeted maxatac_predict.bw and maxatac_predict.bed files with 333 broadpeaks (only value 1 or 0) as output files. I wonder any recommendation for this error?

Thanks,

Timothy

$ maxatac predict -tf CTCF --signal /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/SRR14768461_IS_slop20_RP20M.bw -o /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/

[2023-02-08 17:33:42,280]
Using maxATAC model: /home/txpn/opt/maxatac/data/models/CTCF/CTCF_binary_revcomp99_fullModel_RR0_95.h5 to make predictions
[2023-02-08 17:33:42,282]
Create prediction regions
[2023-02-08 17:34:14,459]
Prediction Parameters 
Output filename: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw 
Target signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/SRR14768461_IS_slop20_RP20M.bw 
Sequence data: /home/txpn/opt/maxatac/data/hg38/hg38.2bit 
Model: /home/txpn/opt/maxatac/data/models/CTCF/CTCF_binary_revcomp99_fullModel_RR0_95.h5 
Chromosome requested: 
   - chr1
    -chr2
    -chr3
    -chr4
    -chr5
    -chr6
    -chr7
    -chr8
    -chr9
    -chr10
    -chr11
    -chr12
    -chr13
    -chr14
    -chr15
    -chr16
    -chr17
    -chr18
    -chr19
    -chr20
    -chr21
    -chr22
Chromosomes in final prediction set: 
   - chr1
    -chr2
    -chr3
    -chr4
    -chr5
    -chr6
    -chr7
    -chr8
    -chr9
    -chr10
    -chr11
    -chr12
    -chr13
    -chr14
    -chr15
    -chr16
    -chr17
    -chr18
    -chr19
    -chr20
    -chr21
    -chr22
Output directory: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/ 
Batch Size: 10000 
Output filename: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
[2023-02-08 17:34:15,864]
Load pre-trained model
2023-02-08 17:34:16.350182: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
[2023-02-08 17:34:16,366]
Load pre-trained model
2023-02-08 17:34:16.372035: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.372124: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.372208: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.380188: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.388385: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.388472: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.388543: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.409651: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-02-08 17:34:16.544758: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.544845: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.544884: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.544926: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.544961: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.544999: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.545033: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.545064: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.545335: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:16,782]
Load pre-trained model
2023-02-08 17:34:16.967527: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967592: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967631: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967666: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967710: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967744: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967777: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.967808: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:16.968042: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:17,233]
Start Prediction Generator
[2023-02-08 17:34:17,233]
Start Prediction Generator
[2023-02-08 17:34:17,233]
Start Prediction Generator
[2023-02-08 17:34:17,234]
Making predictions
[2023-02-08 17:34:17,234]
Making predictions
[2023-02-08 17:34:17,234]
Making predictions
[2023-02-08 17:34:17,286]
Load pre-trained model
2023-02-08 17:34:17.467456: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467521: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467564: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467607: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467647: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467690: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467727: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467760: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.467996: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:17,675]
Start Prediction Generator
[2023-02-08 17:34:17,676]
Making predictions
[2023-02-08 17:34:17,704]
Load pre-trained model
2023-02-08 17:34:17.887659: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887738: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887778: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887815: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887854: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887890: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887926: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.887960: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:17.888196: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:18,098]
Start Prediction Generator
[2023-02-08 17:34:18,099]
Making predictions
[2023-02-08 17:34:18,190]
Load pre-trained model
2023-02-08 17:34:18.380951: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381052: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381119: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381182: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381245: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381304: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381365: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381424: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.381783: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:18,595]
Start Prediction Generator
[2023-02-08 17:34:18,595]
Making predictions
[2023-02-08 17:34:18,672]
Load pre-trained model
2023-02-08 17:34:18.867924: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.867994: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868043: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868080: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868123: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868165: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868205: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868241: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:18.868479: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:19,085]
Start Prediction Generator
[2023-02-08 17:34:19,085]
Making predictions
[2023-02-08 17:34:19,117]
Load pre-trained model
2023-02-08 17:34:19.324160: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324288: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324373: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324462: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324542: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324624: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324701: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.324779: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.325197: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:19,555]
Load pre-trained model
[2023-02-08 17:34:19,589]
Start Prediction Generator
[2023-02-08 17:34:19,589]
Making predictions
2023-02-08 17:34:19.733583: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733649: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733688: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733727: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733767: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733803: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733840: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.733872: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:19.734133: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:19,956]
Start Prediction Generator
[2023-02-08 17:34:19,956]
Making predictions
[2023-02-08 17:34:20,054]
Load pre-trained model
2023-02-08 17:34:20.252044: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252112: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252149: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252189: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252222: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252258: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252291: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252322: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.252678: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:20,502]
Start Prediction Generator
[2023-02-08 17:34:20,503]
Making predictions
[2023-02-08 17:34:20,504]
Load pre-trained model
2023-02-08 17:34:20.687686: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687752: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687791: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687831: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687869: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687907: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687943: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.687974: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:20.688227: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:20,904]
Start Prediction Generator
[2023-02-08 17:34:20,905]
Making predictions
[2023-02-08 17:34:20,958]
Load pre-trained model
2023-02-08 17:34:21.145728: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145796: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145834: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145879: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145914: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145951: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.145984: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.146016: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.146275: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:21,353]
Load pre-trained model
[2023-02-08 17:34:21,372]
Start Prediction Generator
[2023-02-08 17:34:21,372]
Making predictions
2023-02-08 17:34:21.537031: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537097: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537138: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537177: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537211: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537247: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537281: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537314: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:21.537577: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:21,752]
Start Prediction Generator
[2023-02-08 17:34:21,753]
Making predictions
[2023-02-08 17:34:21,834]
Load pre-trained model
2023-02-08 17:34:22.042167: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042237: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042277: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042318: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042353: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042393: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042428: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042460: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.042804: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:22,337]
Load pre-trained model
[2023-02-08 17:34:22,369]
Start Prediction Generator
[2023-02-08 17:34:22,370]
Making predictions
2023-02-08 17:34:22.581040: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581134: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581190: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581247: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581299: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581353: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581402: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581448: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:22.581866: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:22,811]
Load pre-trained model
[2023-02-08 17:34:22,861]
Start Prediction Generator
[2023-02-08 17:34:22,861]
Making predictions
2023-02-08 17:34:23.042754: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.042869: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.042943: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043022: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043091: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043162: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043231: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043295: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.043740: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:23,250]
Load pre-trained model
[2023-02-08 17:34:23,295]
Start Prediction Generator
[2023-02-08 17:34:23,296]
Making predictions
2023-02-08 17:34:23.502513: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502589: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502638: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502686: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502730: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502775: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502812: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.502854: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:23.503250: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:23,763]
Start Prediction Generator
[2023-02-08 17:34:23,763]
Making predictions
[2023-02-08 17:34:23,798]
Load pre-trained model
2023-02-08 17:34:24.000197: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000293: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000352: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000413: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000474: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000528: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000585: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.000640: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.001047: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:24,165]
Load pre-trained model
[2023-02-08 17:34:24,276]
Start Prediction Generator
[2023-02-08 17:34:24,277]
Making predictions
2023-02-08 17:34:24.351771: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.351850: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.351903: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.351954: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.352002: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.352051: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.352100: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.352143: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.352452: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:24,577]
Start Prediction Generator
[2023-02-08 17:34:24,578]
Making predictions
[2023-02-08 17:34:24,754]
Load pre-trained model
2023-02-08 17:34:24.933686: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.933787: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.933854: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.933922: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.933986: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.934050: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.934112: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.934172: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:24.934568: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:25,154]
Start Prediction Generator
[2023-02-08 17:34:25,155]
Making predictions
[2023-02-08 17:34:25,209]
Load pre-trained model
2023-02-08 17:34:25.402265: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402371: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402438: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402510: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402575: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402639: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402702: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.402761: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:25.403216: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:25,643]
Start Prediction Generator
[2023-02-08 17:34:25,643]
Making predictions
[2023-02-08 17:34:25,845]
Load pre-trained model
2023-02-08 17:34:26.069694: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.069797: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.069863: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.069928: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.069994: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcurand.so.10'; dlerror: libcurand.so.10: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.070054: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusolver.so.11'; dlerror: libcusolver.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.070116: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.070174: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2023-02-08 17:34:26.070563: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
[2023-02-08 17:34:26,310]
Start Prediction Generator
[2023-02-08 17:34:26,311]
Making predictions
13/13 [==============================] - 396s 29s/step
14/88 [===>..........................] - ETA: 36:27[2023-02-08 17:41:12,328]
Parsing results into pandas dataframe
13/13 [==============================] - 411s 30s/step
[2023-02-08 17:41:26,389]
Parsing results into pandas dataframe
21/21 [==============================] - 631s 29s/step
23/93 [======>.......................] - ETA: 32:42[2023-02-08 17:45:04,506]
Parsing results into pandas dataframe
24/24 [==============================] - 680s 27s/step
24/51 [=============>................] - ETA: 12:46[2023-02-08 17:45:55,814]
Parsing results into pandas dataframe
29/29 [==============================] - 811s 27s/step
30/30 [==============================] - 813s 26s/step
[2023-02-08 17:48:05,797]
Parsing results into pandas dataframe
31/31 [==============================] - 836s 26s/step
[2023-02-08 17:48:27,922]
Parsing results into pandas dataframe
31/31 [==============================] - 843s 27s/step
[2023-02-08 17:48:34,635]
Parsing results into pandas dataframe
33/93 [=========>....................] - ETA: 26:26[2023-02-08 17:48:55,223]
Parsing results into pandas dataframe
34/34 [==============================] - 894s 26s/step
36/37 [============================>.] - ETA: 25s[2023-02-08 17:49:53,126]
Parsing results into pandas dataframe
37/37 [==============================] - 939s 25s/step
39/46 [========================>.....] - ETA: 2:55[2023-02-08 17:50:52,463]
Parsing results into pandas dataframe
46/46 [==============================] - 1098s 24s/step
45/51 [=========================>....] - ETA: 2:25[2023-02-08 17:52:50,520]
Parsing results into pandas dataframe
51/51 [==============================] - 1171s 23s/step
[2023-02-08 17:54:00,691]
Parsing results into pandas dataframe
51/51 [==============================] - 1181s 23s/step
51/51 [==============================] - 1193s 23s/step
[2023-02-08 17:54:22,728]
Parsing results into pandas dataframe
55/88 [=================>............] - ETA: 12:15[2023-02-08 17:54:52,336]
Parsing results into pandas dataframe
55/55 [==============================] - 1240s 22s/step
56/93 [=================>............] - ETA: 13:41[2023-02-08 17:55:08,851]
Parsing results into pandas dataframe
60/60 [==============================] - 1301s 22s/step
61/88 [===================>..........] - ETA: 9:36 [2023-02-08 17:56:09,695]
Parsing results into pandas dataframe
65/65 [==============================] - 1354s 21s/step
64/73 [=========================>....] - ETA: 3:10[2023-02-08 17:57:01,730]
Parsing results into pandas dataframe
69/69 [==============================] - 1400s 20s/step
68/73 [==========================>...] - ETA: 1:42[2023-02-08 17:57:47,395]
Parsing results into pandas dataframe
73/73 [==============================] - 1454s 20s/step
75/93 [=======================>......] - ETA: 5:49[2023-02-08 17:58:48,960]
Parsing results into pandas dataframe
76/76 [==============================] - 1479s 19s/step
77/88 [=========================>....] - ETA: 3:30[2023-02-08 17:59:05,245]
Parsing results into pandas dataframe
88/88 [==============================] - 1581s 18s/step
[2023-02-08 18:00:47,899]
Parsing results into pandas dataframe
93/93 [==============================] - 1626s 17s/step
[2023-02-08 18:01:32,636]
Parsing results into pandas dataframe
[2023-02-08 18:02:53,430]
Write predictions to a bigwig file
[2023-02-08 18:06:29,941]
Input filename: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
 Target chroms: ['chr1', 'chr2', 'chr3', 'chr4', 'chr5', 'chr6', 'chr7', 'chr8', 'chr9', 'chr10', 'chr11', 'chr12', 'chr13', 'chr14', 'chr15', 'chr16', 'chr17', 'chr18', 'chr19', 'chr20', 'chr21', 'chr22']
 Bin size: 32
 Cutoff type for Threshold: F1
 Cutoff value: None
 Corresponding Threshold for Cutoff Type and Value discovered: 0.454
 Filename prefix: maxatac_predict
 Output directory: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/
 Output filename: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict_32bp.bed
[2023-02-08 18:06:32,517]
Start loading chromosome chr2
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 7568547 bins * 32 bp
[2023-02-08 18:06:32,517]
Start loading chromosome chr1
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 7779888 bins * 32 bp
[2023-02-08 18:06:32,517]
Start loading chromosome chr3
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 6196736 bins * 32 bp
[2023-02-08 18:06:32,517]
Start loading chromosome chr4
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 5944204 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr5
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 5673070 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr7
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4979561 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr6
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 5337686 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr8
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4535582 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr9
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4324834 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr10
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4181169 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr11
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4221456 bins * 32 bp
[2023-02-08 18:06:32,518]
Start loading chromosome chr12
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 4164853 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr13
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 3573885 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr14
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 3345116 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr15
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 3187224 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr17
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 2601795 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr16
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 2823073 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr18
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 2511665 bins * 32 bp
[2023-02-08 18:06:32,519]
Start loading chromosome chr19
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 1831800 bins * 32 bp
[2023-02-08 18:06:32,520]
Start loading chromosome chr20
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 2013880 bins * 32 bp
[2023-02-08 18:06:32,520]
Start loading chromosome chr21
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 1459686 bins * 32 bp
[2023-02-08 18:06:32,520]
Start loading chromosome chr22
  Input signal: /media/txpn/My_Book_Duo/Timothy/20220929_ATACseq/maxatac/predict/maxatac_predict.bw
  Binning: 1588077 bins * 32 bp
[2023-02-08 18:20:03,540]
Total Prediction time: 0:46:21.
XiaotingChen commented 1 year ago

Hi,

Please check & install compatible library versions among TensorFlow, CUDA, and cuDNN from here: https://www.tensorflow.org/install/source#gpu.

Thanks, Xiaoting