tempesta-tech / tempesta-test

Test suite for Tempesta FW
11 stars 4 forks source link

Blinking tests #328

Closed pale-emperor closed 1 year ago

pale-emperor commented 2 years ago

As we can see at last daily test runs. List of tests below have fails/errors. So I disable it by this issue

Address in use - !! test_scheduler (http_rules.test_http.HttpRulesBackupServers 4/5 - Address already in use

! test (very_many_backends.test_deadtime_1M.ChangingSG 1/5 Cannot allocate memory - ! test (very_many_backends.test_deadtime_1M.AddingBackendNewSG test (very_many_backends.test_deadtime_1M.DontModifyBackend 1/5 ! test (very_many_backends.test_deadtime_1M.RemovingBackendSG

Sporadic cache tests FAILURES test (cache.test_cache_control.ResponseMustRevalidateCached test (cache.test_cache_control.StoringResponsesWithSetCookieHeaderProxyRevalidateCache ! test (cache.test_cache_control.RequestOnlyIfCachedCached test (cache.test_cache_control.StoringResponsesToAuthenticatedRequestsMustRevalidateCache2

pale-emperor commented 2 years ago

Also we have failed: cache.test_cache_control.StoringResponsesWithSetCookieHeaderSMaxAgeCache and #154 issues

b3b commented 2 years ago

One more blinking test, cache.test_cache_control.StoringResponsesToAuthenticatedRequestsSMaxAgeCache

======================================================================
FAIL: test (cache.test_cache_control.StoringResponsesToAuthenticatedRequestsSMaxAgeCache)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/tempesta-test/cache/test_cache_control.py", line 183, in test
    self._test()
  File "/root/tempesta-test/cache/test_cache_control.py", line 170, in _test
    self.assertEqual(1, len(srv.requests), "response not cached as expected")
AssertionError: 1 != 2 : response not cached as expected

----------------------------------------------------------------------
b3b commented 2 years ago

And got one more fail, on cache.test_cache.TestCache.test_cache_date


FAIL: test_cache_date (cache.test_cache.TestCache)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/root/tempesta-test/cache/test_cache.py", line 313, in test_cache_date
    self._test(
  File "/root/tempesta-test/cache/test_cache.py", line 91, in _test
    checks.check_tempesta_cache_stats(
  File "/root/tempesta-test/helpers/checks_for_tests.py", line 30, in check_tempesta_cache_stats
    assert tempesta.stats.cache_misses == cache_misses, msg
AssertionError: Tempesta has caching errors in processing HTTP requests.``