datalad / git-annex

A non-official clone of git-annex established for DataLad purposes. No PRs will be merged, but could be used to test perspective git-annex patches. Official git-annex repository: https://git.kitenet.net/index.cgi/git-annex.git/
14 stars 3 forks source link

cron job fail after pydantic 2.0 migration merge #181

Closed yarikoptic closed 7 months ago

yarikoptic commented 8 months ago
Subject: Cron <datalad@smaug> cd ~/git-annex-ci/git-annex/clients && chronic flock -n -E 0 .lock venv/bin/python testannex.py smaug                    
        ~/git-annex-ci/jobs                                                                                                                            

Traceback (most recent call last):                                                                                                                     
  File "/home/datalad/git-annex-ci/git-annex/clients/testannex.py", line 17, in <module>                                                               
    from pydantic import BaseModel, TypeAdapter                                                                                                        
ImportError: cannot import name 'TypeAdapter' from 'pydantic'                                                                                          
(/home/datalad/git-annex-ci/git-annex/clients/venv/lib/python3.9/site-packages/pydantic/__init__.cpython-39-x86_64-linux-gnu.so) 

is that anyhow related to the #180 fix @jwodder ?

jwodder commented 8 months ago

@yarikoptic As I implied in my Slack message, the Python environments that the cronjobs run in need to be manually updated to have the latest version of pydantic.

jwodder commented 8 months ago

@yarikoptic Did you upgrade the openmind7 client? It's been missing from the daily e-mails for the past few days.

yarikoptic commented 8 months ago
done now ```shell yhalchen@openmind7:~/git-annex-ci/git-annex/clients $> source ~/miniconda3/etc/profile.d/conda.sh (git)~/git-annex-ci/git-annex:clients[master] #9 !1280 [0].....................................:Mon Nov 13 17:08:31:. yhalchen@openmind7:~/git-annex-ci/git-annex/clients $> conda activate ./condaenv/ (/home/yhalchen/git-annex-ci/git-annex/clients/condaenv) (git)~/git-annex-ci/git-annex:clients[master] #10 !1281 [0].....................................:Mon Nov 13 17:08:36:. yhalchen@openmind7:~/git-annex-ci/git-annex/clients $> cat requirements.txt click >= 8.0 click-loglevel ~= 0.2 pydantic ~= 2.0 ruamel.yaml ~= 0.15 (/home/yhalchen/git-annex-ci/git-annex/clients/condaenv) (git)~/git-annex-ci/git-annex:clients[master] #11 !1282 [0].....................................:Mon Nov 13 17:08:39:. yhalchen@openmind7:~/git-annex-ci/git-annex/clients $> pip install -r requirements.txt Requirement already satisfied: click>=8.0 in ./condaenv/lib/python3.11/site-packages (from -r requirements.txt (line 1)) (8.1.3) Requirement already satisfied: click-loglevel~=0.2 in ./condaenv/lib/python3.11/site-packages (from -r requirements.txt (line 2)) (0.4.0.post1) Collecting pydantic~=2.0 Downloading pydantic-2.5.0-py3-none-any.whl (407 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 407.5/407.5 kB 5.9 MB/s eta 0:00:00 Requirement already satisfied: ruamel.yaml~=0.15 in ./condaenv/lib/python3.11/site-packages (from -r requirements.txt (line 4)) (0.17.21) Collecting annotated-types>=0.4.0 Downloading annotated_types-0.6.0-py3-none-any.whl (12 kB) Collecting pydantic-core==2.14.1 Downloading pydantic_core-2.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 20.5 MB/s eta 0:00:00 Collecting typing-extensions>=4.6.1 Downloading typing_extensions-4.8.0-py3-none-any.whl (31 kB) Installing collected packages: typing-extensions, annotated-types, pydantic-core, pydantic Attempting uninstall: typing-extensions Found existing installation: typing_extensions 4.4.0 Uninstalling typing_extensions-4.4.0: Successfully uninstalled typing_extensions-4.4.0 Attempting uninstall: pydantic Found existing installation: pydantic 1.10.5 Uninstalling pydantic-1.10.5: Successfully uninstalled pydantic-1.10.5 Successfully installed annotated-types-0.6.0 pydantic-2.5.0 pydantic-core-2.14.1 typing-extensions-4.8.0 ```
jwodder commented 8 months ago

@yarikoptic https://github.com/datalad/git-annex-ci-client-jobs still shows a bunch of job branches that openmind7 has yet to process, and there have been no results pushed from openmind7 since last week. Does the cronjob run only once a day? If it's supposed to run more frequently, can you check the logs?

jwodder commented 8 months ago

@yarikoptic Ping. It still looks like the openmind7 client isn't running.

yarikoptic commented 7 months ago

I resolved the merge conflict and did a test run for openmind, should be ok now