A problem with nat_2d.py

[williamsriver]

Hello, I encountered an issue while using your project.

In the nat_2d.py file, the following code is used to import functions from the NAT module:

from natten.functional import na2d_av, na2d_qk_with_bias

I am using natten version 0.17.0, but the natten.functional module does not contain the na2d_qk_with_bias function. I attempted to use the following import in the agileFormer_sys_2d.pyfile:

from natten.na2d import NeighborhoodAttention2D I would like to confirm if this approach would affect the functionality of the program, or if there is a better solution.

My Conda Virtual Environment:

python = 3.8
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
absl-py                   2.1.0                    pypi_0    pypi
adamp                     0.3.0                    pypi_0    pypi
ca-certificates           2024.3.11            h06a4308_0  
certifi                   2024.6.2                 pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
cmake                     3.20.3                   pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
einops                    0.8.0                    pypi_0    pypi
filelock                  3.14.0                   pypi_0    pypi
fsspec                    2024.6.0                 pypi_0    pypi
h5py                      3.11.0                   pypi_0    pypi
huggingface-hub           0.23.3                   pypi_0    pypi
idna                      3.7                      pypi_0    pypi
jinja2                    3.1.4                    pypi_0    pypi
ld_impl_linux-64          2.38                 h1181459_1  
libffi                    3.4.4                h6a678d5_1  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libstdcxx-ng              11.2.0               h1234567_1  
markupsafe                2.1.5                    pypi_0    pypi
medpy                     0.5.1                    pypi_0    pypi
ml-collections            0.1.1                    pypi_0    pypi
mpmath                    1.3.0                    pypi_0    pypi
natten                    0.17.1+torch230cu121          pypi_0    pypi
ncurses                   6.4                  h6a678d5_0  
networkx                  3.1                      pypi_0    pypi
numpy                     1.24.4                   pypi_0    pypi
nvidia-cublas-cu12        12.1.3.1                 pypi_0    pypi
nvidia-cuda-cupti-cu12    12.1.105                 pypi_0    pypi
nvidia-cuda-nvrtc-cu12    12.1.105                 pypi_0    pypi
nvidia-cuda-runtime-cu12  12.1.105                 pypi_0    pypi
nvidia-cudnn-cu12         8.9.2.26                 pypi_0    pypi
nvidia-cufft-cu12         11.0.2.54                pypi_0    pypi
nvidia-curand-cu12        10.3.2.106               pypi_0    pypi
nvidia-cusolver-cu12      11.4.5.107               pypi_0    pypi
nvidia-cusparse-cu12      12.1.0.106               pypi_0    pypi
nvidia-nccl-cu12          2.20.5                   pypi_0    pypi
nvidia-nvjitlink-cu12     12.5.40                  pypi_0    pypi
nvidia-nvtx-cu12          12.1.105                 pypi_0    pypi
openssl                   3.0.13               h7f8727e_2  
packaging                 24.0                     pypi_0    pypi
pillow                    10.3.0                   pypi_0    pypi
pip                       24.0             py38h06a4308_0  
python                    3.8.19               h955ad1f_0  
pyyaml                    6.0.1                    pypi_0    pypi
readline                  8.2                  h5eee18b_0  
requests                  2.32.3                   pypi_0    pypi
safetensors               0.4.3                    pypi_0    pypi
scipy                     1.10.1                   pypi_0    pypi
setuptools                69.5.1           py38h06a4308_0  
simpleitk                 2.3.1                    pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
sqlite                    3.45.3               h5eee18b_0  
sympy                     1.12.1                   pypi_0    pypi
timm                      1.0.3                    pypi_0    pypi
tk                        8.6.14               h39e8969_0  
torch                     2.3.0+cu121              pypi_0    pypi
torchaudio                2.3.0+cu121              pypi_0    pypi
torchvision               0.18.0+cu121             pypi_0    pypi
tqdm                      4.66.4                   pypi_0    pypi
triton                    2.3.0                    pypi_0    pypi
tvdcn                     0.5.0                    pypi_0    pypi
typing-extensions         4.12.1                   pypi_0    pypi
urllib3                   2.2.1                    pypi_0    pypi
wheel                     0.43.0           py38h06a4308_0  
xz                        5.4.6                h5eee18b_1  
yacs                      0.1.8                    pypi_0    pypi
zlib                      1.2.13               h5eee18b_1  

[peijie-chiu]

@williamsriver I believe you were using the latest natten version, where "na2d_qk_with_bias" has been replaced with "na2d_qk". Simply replacing "na2d_qk_with_bias" with "na2d_qk" should resolve this problem (but I haven't tested it on this version). Let me know if you encounter further issues.

[williamsriver]

Yes! I did use your method to solve the problem. attn = na2d_qk(q, k, self.kernel_size, self.dilation, rpb=self.rpb)

[zhangxuan-thecastle]

Yes! I did use your method to solve the problem. attn = na2d_qk(q, k, self.kernel_size, self.dilation, rpb=self.rpb)

Hello, may I ask if you have reproduced the result of 85.7? I am looking forward to your reply