search

matrix-org / sytest

Black-box integration testing for Matrix homeservers
Apache License 2.0
71 stars 55 forks source link

Synapse: fix the build and reduce logging noise #1334

Closed DMRobertson closed 1 year ago

DMRobertson commented 1 year ago

a42e75a3 origin/dmr/sytest-tweaks Limit number of haproxy connections

Suppresses big scary warnings of the form 

WARN: server process exited 1
[server]: [NOTICE]   (2457) : haproxy version is 2.6.7-1
[server]: [NOTICE]   (2457) : path to executable is /usr/sbin/haproxy
[server]: [ALERT]    (2457) : Not enough memory to allocate 1073741815 entries for fdtab!
[server]: [ALERT]    (2457) : No polling mechanism available.
[server]:   It is likely that haproxy was built with TARGET=generic and that FD_SETSIZE
[server]:   is too low on this platform to support maxconn and the number of listeners
[server]:   and servers. You should rebuild haproxy specifying your system using TARGET=
[server]:   in order to support other polling systems (poll, epoll, kqueue) or reduce the
[server]:   global maxconn setting to accommodate the system's limitation. For reference,
[server]:   FD_SETSIZE=1024 on this system, global.maxconn=536870884 resulting in a maximum of
[server]:   1073741815 file descriptors. You should thus reduce global.maxconn by 536870396. Also,
[server]:   check build settings using 'haproxy -vv'.
[server]: 
WARN: Error starting server-0: Process died without becoming connectable at tests/05homeserver.pl line 126.
WARN: Aborting test run due to failure to start test server at tests/05homeserver.pl line 130.
WARN: server process exited 1
[server]: [NOTICE]   (2466) : haproxy version is 2.6.7-1
[server]: [NOTICE]   (2466) : path to executable is /usr/sbin/haproxy
[server]: [ALERT]    (2466) : Not enough memory to allocate 1073741815 entries for fdtab!
[server]: [ALERT]    (2466) : No polling mechanism available.
[server]:   It is likely that haproxy was built with TARGET=generic and that FD_SETSIZE
[server]:   is too low on this platform to support maxconn and the number of listeners
[server]:   and servers. You should rebuild haproxy specifying your system using TARGET=
[server]:   in order to support other polling systems (poll, epoll, kqueue) or reduce the
[server]:   global maxconn setting to accommodate the system's limitation. For reference,
[server]:   FD_SETSIZE=1024 on this system, global.maxconn=536870884 resulting in a maximum of
[server]:   1073741815 file descriptors. You should thus reduce global.maxconn by 536870396. Also,
[server]:   check build settings using 'haproxy -vv'.
[server]:

19046cf6 Reduce poetry install verbosity

otherwise this means that poetry install tells about every single file it ignores, which includes loads of guff in .mypy_cache and .ruff_cache and others

352d0a70 Fix synapse-sytest:testing build

This might break the other builds though, I haven't tested. See e.g. https://github.com/matrix-org/sytest/actions/workflows/docker.yml

H-Shay commented 1 year ago

I am unclear if the dendrite failures are expected, or the failures at https://github.com/matrix-org/sytest/actions/workflows/docker.yml?

DMRobertson commented 1 year ago

I am unclear if the dendrite failures are expected, or the failures at https://github.com/matrix-org/sytest/actions/workflows/docker.yml?

The dendrite failures are unrelated (and I'll let @matrix-org/dendrite-core fix them up).

I don't recognise the other failures. It looks like debian bookworm (the current testing version) now includes packages for python 3.11 rather than 3.10. I'll see if I can fix that up here.

DMRobertson commented 1 year ago

Sigh. It looks like --break-system-packages only exists on the newest Debians.