Closed charbj closed 10 months ago
Hi Charles, two things:
Hi Nathaniel,
Wicked - thanks. I have it working now. The TF issue had sent me down a long rabbit hole.
I appreciate your help, I'll close the issue.
You guys write awesome software :)
CBJ
Hi,
I've tried installing the envs using the new split conda ymls and when I run af2_importtest.py
I get a seg fault when importing pyrosetta. I've traced the issue to be some sort of compatibility problem between jax/tensorflow and pyrosetta. Any idea of how I can troubleshoot this? I've tried installing the environment in multiple ways and installing different versions of pyrosetta.
Edit: Can any of you please share what version of pyrosetta you're using?
Thanks! Fátima
Hi all,
You weren't kidding about the tensorflow/GPU issues... it's a pain.
I have tried many combinations. I can install tensorflow and have it recognise the GPU, however importing tensorflow and then pyrosetta causes an immediate segmentation fault. Alternatively, importing pyrosetta and then tensorflow causes a floating point exception. I have tracked the issue down to those two imports. It seems agnostic to python 3.8, 3.9, 3.10 and 3.11.
A minimally working example could probably be made by installing pyrosetta and tensorflow.
(Note: I have tried
export TF_ENABLE_ONEDNN_OPTS=0
, however this does nothing).Reversing the imports:
Environment:
I'm fairly happy that tensorflow is working correctly and the CUDA versions are correct. My system is running
Driver Version: 510.39.01 CUDA Version: 11.6
Conversely, if I install a CPU only version of tensorflow, both pyrosetta and tensorflow cooperate - however inference is very slow (as expected).
I have tried on a system with GTX3090s (Driver 510.39.01, CUDA 11.6) and a system with an A6000 (Driver 535.54.03, CUDA 12.2).
The issue is similar. When the GPU is not detected i.e.
tf.config.list_physical_devices('GPU')
reports and empty list[]
, then pyrosetta and tensorflow cooperate. As soon as tf reports physical devices, I encounter segmentation faults. I have tried with tf-nightly, the most recent pyrosetta, and various python versions.Any help at all would be very, very appreciated.
Kindly, Charles