Adamdad / kat

Kolmogorov-Arnold Transformer: A PyTorch Implementation with CUDA kernel
MIT License
583 stars 34 forks source link

undefined symbol: _ZNSt15__exception_ptr13exception_ptr9_M_addrefEv when importing kat_rational_cu #3

Closed wokanmanhua closed 1 month ago

wokanmanhua commented 1 month ago

捕获

There is a problem when importing kat_rational_cu. May I ask if it is due to incompatibility between Python and PyTorch versions. What is the compatible version

wokanmanhua commented 1 month ago

捕获

There is a problem when importing kat_rational_cu. May I ask if it is due to incompatibility of Python and PyTorch versions. What is the compatible version?

Adamdad commented 1 month ago

This is my full env info. Hope you can resolve the problem!

(/local_home/yangxingyi/pt1.10) yangxingyi@deep60:~$ pip list
Package                            Version            Editable project location
---------------------------------- ------------------ ------------------------------------------------------
absl-py                            1.4.0
accelerate                         0.28.0
addict                             2.4.0
airspeed                           0.5.14
albumentations                     1.3.1
alembic                            1.13.1
aliyun-python-sdk-core             2.13.36
aliyun-python-sdk-kms              2.16.1
aniso8601                          9.0.1
antlr4-python3-runtime             4.9.3
apex                               0.1
appdirs                            1.4.4
astunparse                         1.6.3
blessed                            1.20.0
blinker                            1.8.2
cached-property                    1.5.2
cachetools                         5.3.1
certifi                            2023.7.22
cffi                               1.15.1
charset-normalizer                 3.2.0
chex                               0.1.7
click                              8.1.7
cloudpickle                        3.0.0
clu                                0.0.7
cmake                              3.29.2
cmapy                              0.6.6
colorama                           0.4.6
contextlib2                        21.6.0
contourpy                          1.1.0
crcmod                             1.7
cryptography                       41.0.3
cycler                             0.11.0
Deprecated                         1.2.14
diffusers                          0.27.2
diffusers-interpret                0.5.0
dill                               0.3.7
dm-tree                            0.1.8
docker                             7.1.0
docker-pycreds                     0.4.0
easydict                           1.10
efficientnet-pytorch               0.7.1
einops                             0.4.1
entrypoints                        0.4
etils                              1.3.0
fast-tsp                           0.1.2
filelock                           3.12.4
fire                               0.4.0
Flask                              3.0.3
flatbuffers                        23.5.26
flax                               0.6.1
fonttools                          4.42.0
fsspec                             2023.10.0
ftfy                               6.1.3
functorch                          2.0.0
fvcore                             0.1.5.post20221221
gast                               0.4.0
gitdb                              4.0.11
GitPython                          3.1.43
google-auth                        2.22.0
google-auth-oauthlib               0.4.6
google-pasta                       0.2.0
googleapis-common-protos           1.60.0
gpustat                            1.1.1
graphene                           3.3
graphql-core                       3.2.3
graphql-relay                      3.2.0
greenlet                           3.0.3
grpcio                             1.56.2
gunicorn                           22.0.0
h5py                               3.9.0
huggingface-hub                    0.22.1
idna                               3.4
imageio                            2.31.1
imgaug                             0.4.0
importlib-metadata                 6.8.0
importlib-resources                6.0.0
iopath                             0.1.10
itsdangerous                       2.2.0
jax                                0.4.13
jaxlib                             0.4.13
Jinja2                             3.1.4
jmespath                           0.10.0
joblib                             1.3.1
kat-rational                       0.2                /home/yangxingyi/kan/rational_cu
keras                              2.10.0
Keras-Preprocessing                1.1.2
kiwisolver                         1.4.4
lazy_loader                        0.3
libclang                           16.0.6
lit                                18.1.4
lmdb                               1.4.1
Mako                               1.3.5
mamba-ssm                          1.2.2
Markdown                           3.4.4
markdown-it-py                     3.0.0
MarkupSafe                         2.1.3
matplotlib                         3.7.2
mdurl                              0.1.2
medmnist                           2.2.2
ml-collections                     0.1.1
ml-dtypes                          0.2.0
mlflow                             2.13.0
mmcv                               2.0.1
mmcv-full                          1.7.2
mmengine                           0.8.4
mmsegmentation                     1.1.1
model-index                        0.1.11
mpmath                             1.3.0
msgpack                            1.0.5
munch                              4.0.0
networkx                           3.1
ninja                              1.11.1.1
nltk                               3.8.1
numpy                              1.24.4
nvidia-cublas-cu11                 11.10.3.66
nvidia-cuda-cupti-cu11             11.7.101
nvidia-cuda-nvrtc-cu11             11.7.99
nvidia-cuda-runtime-cu11           11.7.99
nvidia-cudnn-cu11                  8.5.0.96
nvidia-cufft-cu11                  10.9.0.58
nvidia-curand-cu11                 10.2.10.91
nvidia-cusolver-cu11               11.4.0.1
nvidia-cusparse-cu11               11.7.4.91
nvidia-ml-py                       12.560.30
nvidia-nccl-cu11                   2.14.3
nvidia-nvtx-cu11                   11.7.91
oauthlib                           3.2.2
omegaconf                          2.3.0
opencv-python                      4.8.1.78
opencv-python-headless             4.8.1.78
opendatalab                        0.0.10
openmim                            0.3.9
opentelemetry-api                  1.24.0
opentelemetry-sdk                  1.24.0
opentelemetry-semantic-conventions 0.45b0
openxlab                           0.0.24
opt-einsum                         3.3.0
optax                              0.1.3
ordered-set                        4.1.0
oss2                               2.17.0
packaging                          23.1
pandas                             2.0.3
Pillow                             10.0.0
pip                                23.2.1
platformdirs                       3.10.0
portalocker                        2.8.2
pretrainedmodels                   0.7.4
prettytable                        3.8.0
promise                            2.3
protobuf                           3.19.5
psutil                             5.9.8
pyarrow                            15.0.2
pyasn1                             0.5.0
pyasn1-modules                     0.3.0
pycparser                          2.21
pycryptodome                       3.18.0
Pygments                           2.15.1
pyparsing                          3.0.9
python-dateutil                    2.8.2
pytorch-wavelets                   1.3.0              /home/yangxingyi/DiffusionMadeSlim/pytorch_wavelets
pytz                               2023.3
PyWavelets                         1.4.1
PyYAML                             6.0.1
qudida                             0.0.4
querystring-parser                 1.2.4
rational-activations               0.2.2
regex                              2023.12.25
requests                           2.28.2
requests-oauthlib                  1.3.1
rich                               13.4.2
rsa                                4.9
safetensors                        0.4.2
scikit-image                       0.21.0
scikit-learn                       1.3.0
scipy                              1.10.1
segmentation-models-pytorch        0.3.3
sentry-sdk                         2.1.1
setproctitle                       1.3.3
setuptools                         60.2.0
shapely                            2.0.2
six                                1.16.0
smmap                              5.0.1
SQLAlchemy                         2.0.30
sqlparse                           0.5.0
sympy                              1.12
tabulate                           0.9.0
taming-transformers                0.0.1              /home/yangxingyi/DiffusionMadeSlim/taming-transformers
tensorboard                        2.10.1
tensorboard-data-server            0.6.1
tensorboard-plugin-wit             1.8.1
tensorflow                         2.10.0
tensorflow-datasets                4.7.0
tensorflow-estimator               2.10.0
tensorflow-io-gcs-filesystem       0.33.0
tensorflow-metadata                1.12.0
termcolor                          2.3.0
threadpoolctl                      3.2.0
tifffile                           2023.7.10
timm                               1.0.3
tokenizers                         0.15.2
toml                               0.10.2
tomli                              2.0.1
toolz                              0.12.0
torch                              2.0.1
torch-pruning                      1.3.7
torchaudio                         2.0.2
torchvision                        0.15.2
tqdm                               4.65.0
transformers                       4.39.1
triton                             2.0.0
typing_extensions                  4.7.1
tzdata                             2023.3
urllib3                            1.26.16
wandb                              0.16.6
wcwidth                            0.2.12
Werkzeug                           3.0.3
wheel                              0.38.4
wrapt                              1.15.0
yacs                               0.1.8
yapf                               0.40.1
zipp                               3.16.2
wokanmanhua commented 1 month ago

Thank you!! Can I see your conda list?

Adamdad commented 1 month ago
(/local_home/yangxingyi/pt1.10) yangxingyi@deep60:~$ conda list
# packages in environment at /local_home/yangxingyi/pt1.10:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main
_openmp_mutex             5.1                       1_gnu
absl-py                   1.4.0                    pypi_0    pypi
accelerate                0.28.0                   pypi_0    pypi
addict                    2.4.0                    pypi_0    pypi
airspeed                  0.5.14                   pypi_0    pypi
albumentations            1.3.1                    pypi_0    pypi
alembic                   1.13.1                   pypi_0    pypi
aliyun-python-sdk-core    2.13.36                  pypi_0    pypi
aliyun-python-sdk-kms     2.16.1                   pypi_0    pypi
aniso8601                 9.0.1                    pypi_0    pypi
antlr4-python3-runtime    4.9.3                    pypi_0    pypi
apex                      0.1                      pypi_0    pypi
appdirs                   1.4.4                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
blessed                   1.20.0                   pypi_0    pypi
blinker                   1.8.2                    pypi_0    pypi
ca-certificates           2024.2.2             hbcca054_0    conda-forge
cached-property           1.5.2                    pypi_0    pypi
cachetools                5.3.1                    pypi_0    pypi
certifi                   2023.7.22                pypi_0    pypi
cffi                      1.15.1                   pypi_0    pypi
charset-normalizer        3.2.0                    pypi_0    pypi
chex                      0.1.7                    pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
cloudpickle               3.0.0                    pypi_0    pypi
clu                       0.0.7                    pypi_0    pypi
cmake                     3.29.2                   pypi_0    pypi
cmapy                     0.6.6                    pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.1.0                    pypi_0    pypi
crcmod                    1.7                      pypi_0    pypi
cryptography              41.0.3                   pypi_0    pypi
cudatoolkit-dev           11.7.0               h1de0b5d_6    conda-forge
cycler                    0.11.0                   pypi_0    pypi
deprecated                1.2.14                   pypi_0    pypi
diffusers                 0.27.2                   pypi_0    pypi
diffusers-interpret       0.5.0                    pypi_0    pypi
dill                      0.3.7                    pypi_0    pypi
dm-tree                   0.1.8                    pypi_0    pypi
docker                    7.1.0                    pypi_0    pypi
docker-pycreds            0.4.0                    pypi_0    pypi
easydict                  1.10                     pypi_0    pypi
efficientnet-pytorch      0.7.1                    pypi_0    pypi
einops                    0.4.1                    pypi_0    pypi
entrypoints               0.4                      pypi_0    pypi
etils                     1.3.0                    pypi_0    pypi
fast-tsp                  0.1.2                    pypi_0    pypi
filelock                  3.12.4                   pypi_0    pypi
fire                      0.4.0                    pypi_0    pypi
flask                     3.0.3                    pypi_0    pypi
flatbuffers               23.5.26                  pypi_0    pypi
flax                      0.6.1                    pypi_0    pypi
fonttools                 4.42.0                   pypi_0    pypi
fsspec                    2023.10.0                pypi_0    pypi
functorch                 2.0.0                    pypi_0    pypi
fvcore                    0.1.5.post20221221          pypi_0    pypi
gast                      0.4.0                    pypi_0    pypi
gitdb                     4.0.11                   pypi_0    pypi
gitpython                 3.1.43                   pypi_0    pypi
google-auth               2.22.0                   pypi_0    pypi
google-auth-oauthlib      0.4.6                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
googleapis-common-protos  1.60.0                   pypi_0    pypi
gpustat                   1.1.1                    pypi_0    pypi
graphene                  3.3                      pypi_0    pypi
graphql-core              3.2.3                    pypi_0    pypi
graphql-relay             3.2.0                    pypi_0    pypi
greenlet                  3.0.3                    pypi_0    pypi
grpcio                    1.56.2                   pypi_0    pypi
gunicorn                  22.0.0                   pypi_0    pypi
h5py                      3.9.0                    pypi_0    pypi
huggingface-hub           0.22.1                   pypi_0    pypi
idna                      3.4                      pypi_0    pypi
imageio                   2.31.1                   pypi_0    pypi
imgaug                    0.4.0                    pypi_0    pypi
importlib-metadata        6.8.0                    pypi_0    pypi
importlib-resources       6.0.0                    pypi_0    pypi
iopath                    0.1.10                   pypi_0    pypi
itsdangerous              2.2.0                    pypi_0    pypi
jax                       0.4.13                   pypi_0    pypi
jaxlib                    0.4.13                   pypi_0    pypi
jinja2                    3.1.4                    pypi_0    pypi
jmespath                  0.10.0                   pypi_0    pypi
joblib                    1.3.1                    pypi_0    pypi
kat-rational              0.2                       dev_0    <develop>
keras                     2.10.0                   pypi_0    pypi
keras-preprocessing       1.1.2                    pypi_0    pypi
kiwisolver                1.4.4                    pypi_0    pypi
lazy-loader               0.3                      pypi_0    pypi
ld_impl_linux-64          2.38                 h1181459_1
libclang                  16.0.6                   pypi_0    pypi
libffi                    3.4.4                h6a678d5_0
libgcc-ng                 11.2.0               h1234567_1
libgomp                   11.2.0               h1234567_1
libstdcxx-ng              11.2.0               h1234567_1
lit                       18.1.4                   pypi_0    pypi
lmdb                      1.4.1                    pypi_0    pypi
mako                      1.3.5                    pypi_0    pypi
mamba-ssm                 1.2.2                    pypi_0    pypi
markdown                  3.4.4                    pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                2.1.3                    pypi_0    pypi
matplotlib                3.7.2                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
medmnist                  2.2.2                    pypi_0    pypi
ml-collections            0.1.1                    pypi_0    pypi
ml-dtypes                 0.2.0                    pypi_0    pypi
mlflow                    2.13.0                   pypi_0    pypi
mmcv                      2.0.1                    pypi_0    pypi
mmcv-full                 1.7.2                    pypi_0    pypi
mmengine                  0.8.4                    pypi_0    pypi
mmsegmentation            1.1.1                    pypi_0    pypi
model-index               0.1.11                   pypi_0    pypi
mpmath                    1.3.0                    pypi_0    pypi
msgpack                   1.0.5                    pypi_0    pypi
munch                     4.0.0                    pypi_0    pypi
ncurses                   6.4                  h6a678d5_0
networkx                  3.1                      pypi_0    pypi
ninja                     1.11.1.1                 pypi_0    pypi
numpy                     1.24.4                   pypi_0    pypi
nvidia-cublas-cu11        11.10.3.66               pypi_0    pypi
nvidia-cuda-cupti-cu11    11.7.101                 pypi_0    pypi
nvidia-cuda-nvrtc-cu11    11.7.99                  pypi_0    pypi
nvidia-cuda-runtime-cu11  11.7.99                  pypi_0    pypi
nvidia-cudnn-cu11         8.5.0.96                 pypi_0    pypi
nvidia-cufft-cu11         10.9.0.58                pypi_0    pypi
nvidia-curand-cu11        10.2.10.91               pypi_0    pypi
nvidia-cusolver-cu11      11.4.0.1                 pypi_0    pypi
nvidia-cusparse-cu11      11.7.4.91                pypi_0    pypi
nvidia-ml-py              12.560.30                pypi_0    pypi
nvidia-nccl-cu11          2.14.3                   pypi_0    pypi
nvidia-nvtx-cu11          11.7.91                  pypi_0    pypi
oauthlib                  3.2.2                    pypi_0    pypi
omegaconf                 2.3.0                    pypi_0    pypi
opencv-python             4.8.1.78                 pypi_0    pypi
opencv-python-headless    4.8.1.78                 pypi_0    pypi
opendatalab               0.0.10                   pypi_0    pypi
openmim                   0.3.9                    pypi_0    pypi
openssl                   3.0.13               h7f8727e_2
opentelemetry-api         1.24.0                   pypi_0    pypi
opentelemetry-sdk         1.24.0                   pypi_0    pypi
opentelemetry-semantic-conventions 0.45b0                   pypi_0    pypi
openxlab                  0.0.24                   pypi_0    pypi
opt-einsum                3.3.0                    pypi_0    pypi
optax                     0.1.3                    pypi_0    pypi
ordered-set               4.1.0                    pypi_0    pypi
oss2                      2.17.0                   pypi_0    pypi
packaging                 23.1                     pypi_0    pypi
pandas                    2.0.3                    pypi_0    pypi
pillow                    10.0.0                   pypi_0    pypi
pip                       23.2.1           py38h06a4308_0
platformdirs              3.10.0                   pypi_0    pypi
portalocker               2.8.2                    pypi_0    pypi
pretrainedmodels          0.7.4                    pypi_0    pypi
prettytable               3.8.0                    pypi_0    pypi
promise                   2.3                      pypi_0    pypi
protobuf                  3.19.5                   pypi_0    pypi
psutil                    5.9.8                    pypi_0    pypi
pyarrow                   15.0.2                   pypi_0    pypi
pyasn1                    0.5.0                    pypi_0    pypi
pyasn1-modules            0.3.0                    pypi_0    pypi
pycparser                 2.21                     pypi_0    pypi
pycryptodome              3.18.0                   pypi_0    pypi
pygments                  2.15.1                   pypi_0    pypi
pyparsing                 3.0.9                    pypi_0    pypi
python                    3.8.17               h955ad1f_0
python-dateutil           2.8.2                    pypi_0    pypi
pytz                      2023.3                   pypi_0    pypi
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0.1                    pypi_0    pypi
qudida                    0.0.4                    pypi_0    pypi
querystring-parser        1.2.4                    pypi_0    pypi
readline                  8.2                  h5eee18b_0
regex                     2023.12.25               pypi_0    pypi
requests                  2.28.2                   pypi_0    pypi
requests-oauthlib         1.3.1                    pypi_0    pypi
rich                      13.4.2                   pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
safetensors               0.4.2                    pypi_0    pypi
scikit-image              0.21.0                   pypi_0    pypi
scikit-learn              1.3.0                    pypi_0    pypi
scipy                     1.10.1                   pypi_0    pypi
segmentation-models-pytorch 0.3.3                    pypi_0    pypi
sentry-sdk                2.1.1                    pypi_0    pypi
setproctitle              1.3.3                    pypi_0    pypi
setuptools                60.2.0                   pypi_0    pypi
shapely                   2.0.2                    pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
smmap                     5.0.1                    pypi_0    pypi
sqlalchemy                2.0.30                   pypi_0    pypi
sqlite                    3.41.2               h5eee18b_0
sqlparse                  0.5.0                    pypi_0    pypi
sympy                     1.12                     pypi_0    pypi
tabulate                  0.9.0                    pypi_0    pypi
tensorboard               2.10.1                   pypi_0    pypi
tensorboard-data-server   0.6.1                    pypi_0    pypi
tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
tensorflow                2.10.0                   pypi_0    pypi
tensorflow-datasets       4.7.0                    pypi_0    pypi
tensorflow-estimator      2.10.0                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.33.0                   pypi_0    pypi
tensorflow-metadata       1.12.0                   pypi_0    pypi
termcolor                 2.3.0                    pypi_0    pypi
threadpoolctl             3.2.0                    pypi_0    pypi
tifffile                  2023.7.10                pypi_0    pypi
timm                      1.0.3                    pypi_0    pypi
tk                        8.6.12               h1ccaba5_0
tokenizers                0.15.2                   pypi_0    pypi
toml                      0.10.2                   pypi_0    pypi
tomli                     2.0.1                    pypi_0    pypi
toolz                     0.12.0                   pypi_0    pypi
torch                     2.0.1                    pypi_0    pypi
torch-pruning             1.3.7                    pypi_0    pypi
torchaudio                2.0.2                    pypi_0    pypi
torchvision               0.15.2                   pypi_0    pypi
tqdm                      4.65.0                   pypi_0    pypi
transformers              4.39.1                   pypi_0    pypi
triton                    2.0.0                    pypi_0    pypi
typing-extensions         4.7.1                    pypi_0    pypi
tzdata                    2023.3                   pypi_0    pypi
urllib3                   1.26.16                  pypi_0    pypi
wandb                     0.16.6                   pypi_0    pypi
wcwidth                   0.2.6                    pypi_0    pypi
werkzeug                  3.0.3                    pypi_0    pypi
wheel                     0.38.4           py38h06a4308_0
wrapt                     1.15.0                   pypi_0    pypi
xz                        5.4.2                h5eee18b_0
yacs                      0.1.8                    pypi_0    pypi
yapf                      0.40.1                   pypi_0    pypi
zipp                      3.16.2                   pypi_0    pypi
zlib                      1.2.13               h5eee18b_0
wokanmanhua commented 1 month ago

Thank you, but I have a question. Aren't you running this code in a virtual environment? Is this a virtual environment activated when running code?

Adamdad commented 1 month ago

Not a virtual machine or docker. I use my own server, with ubuntu system. Using conda to manage the environments.

wokanmanhua commented 1 month ago

Do you use Python 3.8.17 and Pytorch 2.0.1 to run this code?

wokanmanhua commented 1 month ago

If you change the Python version to 3.11, it will solve the problem. It is recommended that the author write the Python and PyTorch versions

Adamdad commented 1 month ago

thank you for the suggestion. Will do!