Most unit tests fail on recent Emacs, Org versions

[jackkamm]

When I try to run the unit tests, they almost all fail.

I'm using following versions of Emacs and Org mode:

Org mode version 9.5.2 (release_9.5.2-25-gaf6f12 @ /usr/share/emacs/28.1/lisp/org/) GNU Emacs 28.1 (build 2, x86_64-pc-linux-gnu, X toolkit, cairo version 1.17.6, Xaw3d scroll bars) of 2022-07-10

I started the caldav server (radicale) like this:

docker run \
    -p 5233:5232 \
    -v /home/jack/dev/emacs-orgmode-notes/220814-org-caldav-unit-tests/data:/data \
    tomsquest/docker-radicale

Then after manually creating the test1 and test2 calendars on the server, I ran the unit tests like so:

ORGCALDAVDIR="~/src/org-caldav/master"
TZ=Europe/Berlin emacs -q -L "$ORGCALDAVDIR" --eval '(setq org-caldav-url "http://localhost:5233/test")' -l "$ORGCALDAVDIR/org-caldav-testsuite.el" -f ert

And this is the output I got from ERT:

Selector: t
Passed:  1
Failed:  8 (8 unexpected)
Skipped: 0
Total:   9/9

Started at:   2022-08-21 02:35:15+0200
Finished.
Finished at:  2022-08-21 02:35:18+0200

FFFFFFFF.

F org-caldav-01-sync-test
    (error "Could not find UID orgcaldavtest@org1.")

F org-caldav-02-change-heading-test
    (ert-test-failed
     ((should
       (looking-at "^\\* second changed heading SCHEDULED: <2009-08-08 Sat> $"))
      :form
      (looking-at "^\\* second changed heading SCHEDULED: <2009-08-08 Sat> $")
      :value nil))

F org-caldav-03-insert-org-entry
    Make sure that ‘org-caldav-insert-org-entry’ works fine.
    (wrong-type-argument stringp 2)

F org-caldav-04-multiple-calendars
    (error "Could not find UID orgcaldavtest@org1.")

F org-caldav-05-multiple-calendars-agenda-skip-function
    (error "Could not find UID orgcaldavtest@org1.")

F org-caldav-06-org-caldav-files-nil
    (ert-test-failed
     ((should
       (equal
    '(... ...)
    org-caldav-sync-result))
      :form
      (equal
       (("test1" "orgcaldavtest@cal1" new-in-cal cal->org)
    ("test1" "orgcaldavtest-cal2" new-in-cal cal->org))
       (("test1" "orgcaldavtest-cal2" new-in-cal cal->org)
    ("test1" "orgcaldavtest@cal1" new-in-cal cal->org)))
      :value nil :explanation
      (list-elt 0
        (list-elt 1
              (array-elt 13
                     (different-atoms ... ...))))))

F org-caldav-07-detect-removed-file
    (error "Could not find UID orgcaldavtest@org1.")

F org-caldav-08-test-setting-sync-direction
    (error "Could not find UID orgcaldavtest@org1.")