search

docker-library / memcached

Docker Official Image packaging for memcached
http://memcached.org/
BSD 3-Clause "New" or "Revised" License
132 stars 99 forks source link

1.6.8 fails to build on i386 and mips64le #60

Closed tianon closed 4 years ago

tianon commented 4 years ago

The i386 failure can be seen in GitHub Actions at https://github.com/docker-library/memcached/runs/1316079051, the mips64le failure appears very similar.

`i386` test failure logs: ```console + make test ./sizes Slab Stats 64 Thread stats -6384 Global stats 200 Settings 576 Item (no cas) 32 Item (cas) 40 extstore header 12 Libevent thread 112 Connection 292 Response object 1128 Response bundle 12 Response objects per bundle 14 ---------------------------------------- libevent thread cumulative 6528 Thread stats cumulative 6416 ./testapp 1..58 ok 1 - cache_create ok 2 - cache_constructor ok 3 - cache_constructor_fail ok 4 - cache_destructor ok 5 - cache_reuse ok 6 - cache_redzone ok 7 - cache_limit_revised_downward ok 8 - stats_prefix_find ok 9 - stats_prefix_record_get ok 10 - stats_prefix_record_delete ok 11 - stats_prefix_record_set ok 12 - stats_prefix_dump ok 13 - issue_161 ok 14 - strtol ok 15 - strtoll ok 16 - strtoul ok 17 - strtoull ok 18 - issue_44 ok 19 - vperror ok 20 - issue_101 Signal handled: Terminated. ok 21 - start_server ok 22 - issue_92 ok 23 - issue_102 ok 24 - binary_noop ok 25 - binary_quit ok 26 - binary_quitq ok 27 - binary_set ok 28 - binary_setq ok 29 - binary_add ok 30 - binary_addq ok 31 - binary_replace ok 32 - binary_replaceq ok 33 - binary_delete ok 34 - binary_deleteq ok 35 - binary_get ok 36 - binary_getq ok 37 - binary_getk ok 38 - binary_getkq ok 39 - binary_gat ok 40 - binary_gatq ok 41 - binary_gatk ok 42 - binary_gatkq ok 43 - binary_incr ok 44 - binary_incrq ok 45 - binary_decr ok 46 - binary_decrq ok 47 - binary_version ok 48 - binary_flush ok 49 - binary_flushq ok 50 - binary_append ok 51 - binary_appendq ok 52 - binary_prepend ok 53 - binary_prependq ok 54 - binary_stat ok 55 - binary_illegal ok 56 - binary_pipeline_hickup Signal handled: Interrupt. ok 57 - shutdown ok 58 - stop_server make[1]: Entering directory '/usr/src/memcached' Running basic tests with TLS 1..58 ok 1 - cache_create ok 2 - cache_constructor ok 3 - cache_constructor_fail ok 4 - cache_destructor ok 5 - cache_reuse ok 6 - cache_redzone ok 7 - cache_limit_revised_downward ok 8 - stats_prefix_find ok 9 - stats_prefix_record_get ok 10 - stats_prefix_record_delete ok 11 - stats_prefix_record_set ok 12 - stats_prefix_dump ok 13 - issue_161 ok 14 - strtol ok 15 - strtoll ok 16 - strtoul ok 17 - strtoull ok 18 - issue_44 ok 19 - vperror ok 20 - issue_101 Signal handled: Terminated. ok 21 - start_server ok 22 - issue_92 ok 23 - issue_102 ok 24 - binary_noop ok 25 - binary_quit ok 26 - binary_quitq ok 27 - binary_set ok 28 - binary_setq ok 29 - binary_add ok 30 - binary_addq ok 31 - binary_replace ok 32 - binary_replaceq ok 33 - binary_delete ok 34 - binary_deleteq ok 35 - binary_get ok 36 - binary_getq ok 37 - binary_getk ok 38 - binary_getkq ok 39 - binary_gat ok 40 - binary_gatq ok 41 - binary_gatk ok 42 - binary_gatkq ok 43 - binary_incr ok 44 - binary_incrq ok 45 - binary_decr ok 46 - binary_decrq ok 47 - binary_version ok 48 - binary_flush ok 49 - binary_flushq ok 50 - binary_append ok 51 - binary_appendq ok 52 - binary_prepend ok 53 - binary_prependq ok 54 - binary_stat ok 55 - binary_illegal ok 56 - binary_pipeline_hickup Signal handled: Interrupt. ok 57 - shutdown ok 58 - stop_server # Some chunked item tests ./t/binary.t .................. ok ./t/getset.t .................. ok ./t/ssl_cert_refresh.t ........ ok ./t/ssl_ports.t ............... ok ./t/ssl_session_resumption.t .. ok ./t/ssl_settings.t ............ ok ./t/ssl_verify_modes.t ........ ok All tests successful. Files=7, Tests=43196, 69 wallclock secs ( 4.34 usr 0.34 sys + 11.04 cusr 1.96 csys = 17.68 CPU) Result: PASS Finished running basic TLS tests make[1]: Leaving directory '/usr/src/memcached' getaddrinfo(): Name does not resolve failed to listen on TCP port 36377: Resource temporarily unavailable slab class 1: chunk size 80 perslab 13107 slab class 2: chunk size 104 perslab 10082 slab class 3: chunk size 136 perslab 7710 slab class 4: chunk size 176 perslab 5957 slab class 5: chunk size 224 perslab 4681 slab class 6: chunk size 280 perslab 3744 slab class 7: chunk size 352 perslab 2978 slab class 8: chunk size 440 perslab 2383 slab class 9: chunk size 552 perslab 1899 slab class 10: chunk size 696 perslab 1506 slab class 11: chunk size 872 perslab 1202 slab class 12: chunk size 1096 perslab 956 slab class 13: chunk size 1376 perslab 762 slab class 14: chunk size 1720 perslab 609 slab class 15: chunk size 2152 perslab 487 slab class 16: chunk size 2696 perslab 388 slab class 17: chunk size 3376 perslab 310 slab class 18: chunk size 4224 perslab 248 slab class 19: chunk size 5280 perslab 198 slab class 20: chunk size 6600 perslab 158 slab class 21: chunk size 8256 perslab 127 slab class 22: chunk size 10320 perslab 101 slab class 23: chunk size 12904 perslab 81 slab class 24: chunk size 16136 perslab 64 slab class 25: chunk size 20176 perslab 51 slab class 26: chunk size 25224 perslab 41 slab class 27: chunk size 31536 perslab 33 slab class 28: chunk size 39424 perslab 26 slab class 29: chunk size 49280 perslab 21 slab class 30: chunk size 61600 perslab 17 slab class 31: chunk size 77000 perslab 13 slab class 32: chunk size 96256 perslab 10 slab class 33: chunk size 120320 perslab 8 slab class 34: chunk size 150400 perslab 6 slab class 35: chunk size 188000 perslab 5 slab class 36: chunk size 235000 perslab 4 slab class 37: chunk size 293752 perslab 3 slab class 38: chunk size 367192 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (auto-negotiate) <27 new auto-negotiating client connection <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler slab class 1: chunk size 80 perslab 13107 slab class 2: chunk size 104 perslab 10082 slab class 3: chunk size 136 perslab 7710 slab class 4: chunk size 176 perslab 5957 slab class 5: chunk size 224 perslab 4681 slab class 6: chunk size 280 perslab 3744 slab class 7: chunk size 352 perslab 2978 slab class 8: chunk size 440 perslab 2383 slab class 9: chunk size 552 perslab 1899 slab class 10: chunk size 696 perslab 1506 slab class 11: chunk size 872 perslab 1202 slab class 12: chunk size 1096 perslab 956 slab class 13: chunk size 1376 perslab 762 slab class 14: chunk size 1720 perslab 609 slab class 15: chunk size 2152 perslab 487 slab class 16: chunk size 2696 perslab 388 slab class 17: chunk size 3376 perslab 310 slab class 18: chunk size 4224 perslab 248 slab class 19: chunk size 5280 perslab 198 slab class 20: chunk size 6600 perslab 158 slab class 21: chunk size 8256 perslab 127 slab class 22: chunk size 10320 perslab 101 slab class 23: chunk size 12904 perslab 81 slab class 24: chunk size 16136 perslab 64 slab class 25: chunk size 20176 perslab 51 slab class 26: chunk size 25224 perslab 41 slab class 27: chunk size 31536 perslab 33 slab class 28: chunk size 39424 perslab 26 slab class 29: chunk size 49280 perslab 21 slab class 30: chunk size 61600 perslab 17 slab class 31: chunk size 77000 perslab 13 slab class 32: chunk size 96256 perslab 10 slab class 33: chunk size 120320 perslab 8 slab class 34: chunk size 150400 perslab 6 slab class 35: chunk size 188000 perslab 5 slab class 36: chunk size 235000 perslab 4 slab class 37: chunk size 293752 perslab 3 slab class 38: chunk size 367192 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (ascii) stopped maintainer stopped slab mover stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped <27 new ascii client connection. <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler slab class 1: chunk size 80 perslab 13107 slab class 2: chunk size 104 perslab 10082 slab class 3: chunk size 136 perslab 7710 slab class 4: chunk size 176 perslab 5957 slab class 5: chunk size 224 perslab 4681 slab class 6: chunk size 280 perslab 3744 slab class 7: chunk size 352 perslab 2978 slab class 8: chunk size 440 perslab 2383 slab class 9: chunk size 552 perslab 1899 slab class 10: chunk size 696 perslab 1506 slab class 11: chunk size 872 perslab 1202 slab class 12: chunk size 1096 perslab 956 slab class 13: chunk size 1376 perslab 762 slab class 14: chunk size 1720 perslab 609 slab class 15: chunk size 2152 perslab 487 slab class 16: chunk size 2696 perslab 388 slab class 17: chunk size 3376 perslab 310 slab class 18: chunk size 4224 perslab 248 slab class 19: chunk size 5280 perslab 198 slab class 20: chunk size 6600 perslab 158 slab class 21: chunk size 8256 perslab 127 slab class 22: chunk size 10320 perslab 101 slab class 23: chunk size 12904 perslab 81 slab class 24: chunk size 16136 perslab 64 slab class 25: chunk size 20176 perslab 51 slab class 26: chunk size 25224 perslab 41 slab class 27: chunk size 31536 perslab 33 slab class 28: chunk size 39424 perslab 26 slab class 29: chunk size 49280 perslab 21 slab class 30: chunk size 61600 perslab 17 slab class 31: chunk size 77000 perslab 13 slab class 32: chunk size 96256 perslab 10 slab class 33: chunk size 120320 perslab 8 slab class 34: chunk size 150400 perslab 6 slab class 35: chunk size 188000 perslab 5 slab class 36: chunk size 235000 perslab 4 slab class 37: chunk size 293752 perslab 3 slab class 38: chunk size 367192 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (binary) stopped maintainer stopped slab mover stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped <27 new binary client connection. <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler Invalid value for binding protocol: http -- should be one of auto, binary, or ascii stopped maintainer stopped slab mover stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped Maximum connections must be greater than 0 Maximum connections must be greater than 0 Number of threads must be greater than 0 t/00-startup.t .............. ok t/64bit.t ................... skipped: Skipping 64-bit tests on 32-bit build t/ascii-auth.t .............. ok t/binary-extstore.t ......... ok t/binary-get.t .............. ok t/binary-sasl.t ............. skipped: Skipping SASL tests # Some chunked item tests t/binary.t .................. ok t/bogus-commands.t .......... ok t/cas.t ..................... ok t/chunked-extstore.t ........ ok t/chunked-items.t ........... ok DEPRECATED: resp_obj_mem_limit no longer used. See read_buf_mem_limit, t/conn-limits.t ............. ok t/daemonize.t ............... ok t/dash-M.t .................. ok t/dyn-maxbytes.t ............ ok t/error-extstore.t .......... ok t/evictions.t ............... ok t/expirations.t ............. ok t/extstore-buckets.t ........ ok t/extstore-jbod.t ........... ok t/extstore.t ................ ok t/flags.t ................... ok t/flush-all.t ............... ok t/getandtouch.t ............. ok t/getset.t .................. ok # Failed test 'check disconnected' # at t/idle-timeout.t line 38. # got: '{�' # expected: undef # Failed test 'check stats timeout' # at t/idle-timeout.t line 43. # got: '0' # expected: anything else # Looks like you failed 2 tests of 11. t/idle-timeout.t ............ Dubious, test returned 2 (wstat 512, 0x200) Failed 2/11 subtests t/incrdecr.t ................ ok t/issue_104.t ............... ok t/issue_108.t ............... ok t/issue_14.t ................ ok t/issue_140.t ............... skipped: Fix for Issue 140 was only an illusion t/issue_152.t ............... ok t/issue_163.t ............... ok t/issue_183.t ............... ok t/issue_192.t ............... ok t/issue_22.t ................ ok t/issue_260.t ............... skipped: Only possible to test #260 under artificial conditions t/issue_29.t ................ ok t/issue_3.t ................. ok t/issue_41.t ................ ok t/issue_42.t ................ ok t/issue_50.t ................ ok t/issue_61.t ................ ok t/issue_67.t ................ ok t/issue_68.t ................ ok t/issue_70.t ................ ok Item max size cannot be less than 1024 bytes. Cannot set item size limit higher than 1/2 of memory max. t/item_size_max.t ........... ok t/line-lengths.t ............ ok t/lru-crawler.t ............. ok t/lru-maintainer.t .......... ok t/lru.t ..................... ok t/malicious-commands.t ...... ok t/maxconns.t ................ skipped: maxconns test does not work # marithmetic tests # mset mode switch # starting serve stale with mdelete # running mdelete # trying to fail then stale set via mset # confirm item still stale, and TTL wasn't raised. # do valid mset # testing quiet flag # now purposefully cause an error # testing mget opaque # flag and token count errors # pipeline test # mget + extstore tests t/metaget.t ................. ok t/misbehave.t ............... skipped: Privilege drop not supported t/multiversioning.t ......... ok t/noreply.t ................. ok t/quit.t .................... ok t/refhang.t ................. skipped: Test is flaky. Needs special hooks. [restart] Failed to read a tag from metadata file [restart] no metadata save file, starting with a clean cache # Set some values, various sizes. # load enough items to change hash power level # Load a couple chunked items # Data that should expire while stopped. # killed, waiting Gracefully stopping # reconnected # low TTL item should be gone t/restart.t ................. ok t/slabhang.t ................ skipped: Test is flaky. Needs special hooks. t/slabs-reassign-chunked.t .. ok t/slabs-reassign2.t ......... ok t/slabs_reassign.t .......... ok t/ssl_cert_refresh.t ........ skipped: SSL testing is not enabled t/ssl_ports.t ............... skipped: SSL testing is not enabled t/ssl_session_resumption.t .. skipped: SSL testing is not enabled t/ssl_settings.t ............ skipped: SSL testing is not enabled t/ssl_verify_modes.t ........ skipped: SSL testing is not enabled PORT: 43262 t/stats-conns.t ............. ok t/stats-detail.t ............ ok t/stats.t ................... ok t/strtol-testing.t .......... ok t/touch.t ................... ok t/udp.t ..................... ok t/unixsocket.t .............. ok t/watcher.t ................. ok t/watcher_connid.t .......... ok t/whitespace.t .............. skipped: Skipping test because this does not appear to be a memcached git working directory Test Summary Report ------------------- t/idle-timeout.t (Wstat: 512 Tests: 11 Failed: 2) Failed tests: 10-11 Non-zero exit status: 2 Files=79, Tests=104441, 487 wallclock secs (16.40 usr 1.04 sys + 36.64 cusr 11.44 csys = 65.52 CPU) Result: FAIL make: *** [Makefile:2299: test] Error 1 ```
`mips64le` test failure logs: ```console + make test ./sizes Slab Stats 64 Thread stats -6368 Global stats 208 Settings 640 Item (no cas) 48 Item (cas) 56 extstore header 12 Libevent thread 216 Connection 456 Response object 1176 Response bundle 24 Response objects per bundle 13 ---------------------------------------- libevent thread cumulative 6648 Thread stats cumulative 6432 ./testapp 1..58 ok 1 - cache_create ok 2 - cache_constructor ok 3 - cache_constructor_fail ok 4 - cache_destructor ok 5 - cache_reuse ok 6 - cache_redzone ok 7 - cache_limit_revised_downward ok 8 - stats_prefix_find ok 9 - stats_prefix_record_get ok 10 - stats_prefix_record_delete ok 11 - stats_prefix_record_set ok 12 - stats_prefix_dump ok 13 - issue_161 ok 14 - strtol ok 15 - strtoll ok 16 - strtoul ok 17 - strtoull ok 18 - issue_44 ok 19 - vperror ok 20 - issue_101 ok 21 - start_server ok 22 - issue_92 ok 23 - issue_102 ok 24 - binary_noop ok 25 - binary_quit ok 26 - binary_quitq ok 27 - binary_set ok 28 - binary_setq ok 29 - binary_add ok 30 - binary_addq ok 31 - binary_replace ok 32 - binary_replaceq ok 33 - binary_delete ok 34 - binary_deleteq ok 35 - binary_get ok 36 - binary_getq ok 37 - binary_getk ok 38 - binary_getkq ok 39 - binary_gat ok 40 - binary_gatq ok 41 - binary_gatk ok 42 - binary_gatkq ok 43 - binary_incr ok 44 - binary_incrq ok 45 - binary_decr ok 46 - binary_decrq ok 47 - binary_version Signal handled: Terminated. ok 48 - binary_flush ok 49 - binary_flushq ok 50 - binary_append ok 51 - binary_appendq ok 52 - binary_prepend ok 53 - binary_prependq ok 54 - binary_stat ok 55 - binary_illegal ok 56 - binary_pipeline_hickup ok 57 - shutdown ok 58 - stop_server make[1]: Entering directory '/usr/src/memcached' Running basic tests with TLS 1..58 ok 1 - cache_create ok 2 - cache_constructor ok 3 - cache_constructor_fail ok 4 - cache_destructor ok 5 - cache_reuse ok 6 - cache_redzone ok 7 - cache_limit_revised_downward ok 8 - stats_prefix_find ok 9 - stats_prefix_record_get ok 10 - stats_prefix_record_delete ok 11 - stats_prefix_record_set ok 12 - stats_prefix_dump ok 13 - issue_161 ok 14 - strtol ok 15 - strtoll ok 16 - strtoul ok 17 - strtoull Signal handled: Interrupt. ok 18 - issue_44 ok 19 - vperror ok 20 - issue_101 ok 21 - start_server getpeername: Transport endpoint is not connected ok 22 - issue_92 ok 23 - issue_102 ok 24 - binary_noop ok 25 - binary_quit ok 26 - binary_quitq ok 27 - binary_set ok 28 - binary_setq ok 29 - binary_add ok 30 - binary_addq ok 31 - binary_replace ok 32 - binary_replaceq ok 33 - binary_delete ok 34 - binary_deleteq ok 35 - binary_get ok 36 - binary_getq ok 37 - binary_getk ok 38 - binary_getkq ok 39 - binary_gat ok 40 - binary_gatq ok 41 - binary_gatk ok 42 - binary_gatkq ok 43 - binary_incr ok 44 - binary_incrq ok 45 - binary_decr ok 46 - binary_decrq ok 47 - binary_version Signal handled: Terminated. ok 48 - binary_flush ok 49 - binary_flushq ok 50 - binary_append ok 51 - binary_appendq ok 52 - binary_prepend ok 53 - binary_prependq ok 54 - binary_stat ok 55 - binary_illegal ok 56 - binary_pipeline_hickup ok 57 - shutdown ok 58 - stop_server Signal handled: Interrupt. # Some chunked item tests ./t/binary.t .................. ok ./t/getset.t .................. ok ./t/ssl_cert_refresh.t ........ ok ./t/ssl_ports.t ............... ok ./t/ssl_session_resumption.t .. ok ./t/ssl_settings.t ............ ok ./t/ssl_verify_modes.t ........ ok All tests successful. Files=7, Tests=43196, 104 wallclock secs ( 7.00 usr 0.38 sys + 41.57 cusr 1.42 csys = 50.37 CPU) Result: PASS Finished running basic TLS tests make[1]: Leaving directory '/usr/src/memcached' getaddrinfo(): Name or service not known failed to listen on TCP port 41363: Invalid argument slab class 1: chunk size 96 perslab 10922 slab class 2: chunk size 120 perslab 8738 slab class 3: chunk size 152 perslab 6898 slab class 4: chunk size 192 perslab 5461 slab class 5: chunk size 240 perslab 4369 slab class 6: chunk size 304 perslab 3449 slab class 7: chunk size 384 perslab 2730 slab class 8: chunk size 480 perslab 2184 slab class 9: chunk size 600 perslab 1747 slab class 10: chunk size 752 perslab 1394 slab class 11: chunk size 944 perslab 1110 slab class 12: chunk size 1184 perslab 885 slab class 13: chunk size 1480 perslab 708 slab class 14: chunk size 1856 perslab 564 slab class 15: chunk size 2320 perslab 451 slab class 16: chunk size 2904 perslab 361 slab class 17: chunk size 3632 perslab 288 slab class 18: chunk size 4544 perslab 230 slab class 19: chunk size 5680 perslab 184 slab class 20: chunk size 7104 perslab 147 slab class 21: chunk size 8880 perslab 118 slab class 22: chunk size 11104 perslab 94 slab class 23: chunk size 13880 perslab 75 slab class 24: chunk size 17352 perslab 60 slab class 25: chunk size 21696 perslab 48 slab class 26: chunk size 27120 perslab 38 slab class 27: chunk size 33904 perslab 30 slab class 28: chunk size 42384 perslab 24 slab class 29: chunk size 52984 perslab 19 slab class 30: chunk size 66232 perslab 15 slab class 31: chunk size 82792 perslab 12 slab class 32: chunk size 103496 perslab 10 slab class 33: chunk size 129376 perslab 8 slab class 34: chunk size 161720 perslab 6 slab class 35: chunk size 202152 perslab 5 slab class 36: chunk size 252696 perslab 4 slab class 37: chunk size 315872 perslab 3 slab class 38: chunk size 394840 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (auto-negotiate) <27 new auto-negotiating client connection <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler stopped maintainer stopped slab mover slab class 1: chunk size 96 perslab 10922 slab class 2: chunk size 120 perslab 8738 slab class 3: chunk size 152 perslab 6898 slab class 4: chunk size 192 perslab 5461 slab class 5: chunk size 240 perslab 4369 slab class 6: chunk size 304 perslab 3449 slab class 7: chunk size 384 perslab 2730 slab class 8: chunk size 480 perslab 2184 slab class 9: chunk size 600 perslab 1747 slab class 10: chunk size 752 perslab 1394 slab class 11: chunk size 944 perslab 1110 slab class 12: chunk size 1184 perslab 885 slab class 13: chunk size 1480 perslab 708 slab class 14: chunk size 1856 perslab 564 slab class 15: chunk size 2320 perslab 451 slab class 16: chunk size 2904 perslab 361 slab class 17: chunk size 3632 perslab 288 slab class 18: chunk size 4544 perslab 230 slab class 19: chunk size 5680 perslab 184 slab class 20: chunk size 7104 perslab 147 slab class 21: chunk size 8880 perslab 118 slab class 22: chunk size 11104 perslab 94 slab class 23: chunk size 13880 perslab 75 slab class 24: chunk size 17352 perslab 60 slab class 25: chunk size 21696 perslab 48 slab class 26: chunk size 27120 perslab 38 slab class 27: chunk size 33904 perslab 30 slab class 28: chunk size 42384 perslab 24 slab class 29: chunk size 52984 perslab 19 slab class 30: chunk size 66232 perslab 15 slab class 31: chunk size 82792 perslab 12 slab class 32: chunk size 103496 perslab 10 slab class 33: chunk size 129376 perslab 8 slab class 34: chunk size 161720 perslab 6 slab class 35: chunk size 202152 perslab 5 slab class 36: chunk size 252696 perslab 4 slab class 37: chunk size 315872 perslab 3 slab class 38: chunk size 394840 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (ascii) stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped <27 new ascii client connection. <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler stopped maintainer stopped slab mover slab class 1: chunk size 96 perslab 10922 slab class 2: chunk size 120 perslab 8738 slab class 3: chunk size 152 perslab 6898 slab class 4: chunk size 192 perslab 5461 slab class 5: chunk size 240 perslab 4369 slab class 6: chunk size 304 perslab 3449 slab class 7: chunk size 384 perslab 2730 slab class 8: chunk size 480 perslab 2184 slab class 9: chunk size 600 perslab 1747 slab class 10: chunk size 752 perslab 1394 slab class 11: chunk size 944 perslab 1110 slab class 12: chunk size 1184 perslab 885 slab class 13: chunk size 1480 perslab 708 slab class 14: chunk size 1856 perslab 564 slab class 15: chunk size 2320 perslab 451 slab class 16: chunk size 2904 perslab 361 slab class 17: chunk size 3632 perslab 288 slab class 18: chunk size 4544 perslab 230 slab class 19: chunk size 5680 perslab 184 slab class 20: chunk size 7104 perslab 147 slab class 21: chunk size 8880 perslab 118 slab class 22: chunk size 11104 perslab 94 slab class 23: chunk size 13880 perslab 75 slab class 24: chunk size 17352 perslab 60 slab class 25: chunk size 21696 perslab 48 slab class 26: chunk size 27120 perslab 38 slab class 27: chunk size 33904 perslab 30 slab class 28: chunk size 42384 perslab 24 slab class 29: chunk size 52984 perslab 19 slab class 30: chunk size 66232 perslab 15 slab class 31: chunk size 82792 perslab 12 slab class 32: chunk size 103496 perslab 10 slab class 33: chunk size 129376 perslab 8 slab class 34: chunk size 161720 perslab 6 slab class 35: chunk size 202152 perslab 5 slab class 36: chunk size 252696 perslab 4 slab class 37: chunk size 315872 perslab 3 slab class 38: chunk size 394840 perslab 2 slab class 39: chunk size 524288 perslab 2 <26 server listening (binary) stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped <27 new binary client connection. <27 connection closed. stopped assoc asking workers to stop asking background threads to stop stopped lru crawler stopped maintainer stopped slab mover Invalid value for binding protocol: http -- should be one of auto, binary, or ascii stopped logger thread stopped idle timeout thread closing connections <26 connection closed. reaping worker threads all background threads stopped Maximum connections must be greater than 0 Maximum connections must be greater than 0 Number of threads must be greater than 0 t/00-startup.t .............. ok t/64bit.t ................... ok t/ascii-auth.t .............. ok t/binary-extstore.t ......... ok t/binary-get.t .............. ok t/binary-sasl.t ............. skipped: Skipping SASL tests # Some chunked item tests t/binary.t .................. ok t/bogus-commands.t .......... ok t/cas.t ..................... ok t/chunked-extstore.t ........ ok t/chunked-items.t ........... ok DEPRECATED: resp_obj_mem_limit no longer used. See read_buf_mem_limit, t/conn-limits.t ............. ok t/daemonize.t ............... ok t/dash-M.t .................. ok t/dyn-maxbytes.t ............ ok t/error-extstore.t .......... ok t/evictions.t ............... ok t/expirations.t ............. ok t/extstore-buckets.t ........ ok t/extstore-jbod.t ........... ok t/extstore.t ................ ok t/flags.t ................... ok t/flush-all.t ............... ok t/getandtouch.t ............. ok t/getset.t .................. ok # Failed test 'check disconnected' # at t/idle-timeout.t line 38. # got: '��' # expected: undef # Failed test 'check stats timeout' # at t/idle-timeout.t line 43. # got: '0' # expected: anything else # Looks like you failed 2 tests of 11. t/idle-timeout.t ............ Dubious, test returned 2 (wstat 512, 0x200) Failed 2/11 subtests t/incrdecr.t ................ ok t/issue_104.t ............... ok t/issue_108.t ............... ok t/issue_14.t ................ ok t/issue_140.t ............... skipped: Fix for Issue 140 was only an illusion t/issue_152.t ............... ok t/issue_163.t ............... ok t/issue_183.t ............... ok t/issue_192.t ............... ok t/issue_22.t ................ ok t/issue_260.t ............... skipped: Only possible to test #260 under artificial conditions t/issue_29.t ................ ok t/issue_3.t ................. ok t/issue_41.t ................ ok t/issue_42.t ................ ok t/issue_50.t ................ ok t/issue_61.t ................ ok t/issue_67.t ................ ok t/issue_68.t ................ ok t/issue_70.t ................ ok Item max size cannot be less than 1024 bytes. Cannot set item size limit higher than 1/2 of memory max. t/item_size_max.t ........... ok t/line-lengths.t ............ ok t/lru-crawler.t ............. ok t/lru-maintainer.t .......... ok t/lru.t ..................... ok t/malicious-commands.t ...... ok t/maxconns.t ................ skipped: maxconns test does not work # marithmetic tests # mset mode switch # starting serve stale with mdelete # running mdelete # trying to fail then stale set via mset # confirm item still stale, and TTL wasn't raised. # do valid mset # testing quiet flag # now purposefully cause an error # testing mget opaque # flag and token count errors # pipeline test # mget + extstore tests t/metaget.t ................. ok t/misbehave.t ............... skipped: Privilege drop not supported t/multiversioning.t ......... ok t/noreply.t ................. ok t/quit.t .................... ok t/refhang.t ................. skipped: Test is flaky. Needs special hooks. [restart] Failed to read a tag from metadata file [restart] no metadata save file, starting with a clean cache # Set some values, various sizes. # load enough items to change hash power level # Load a couple chunked items # Data that should expire while stopped. # killed, waiting Gracefully stopping # reconnected # low TTL item should be gone t/restart.t ................. ok t/slabhang.t ................ skipped: Test is flaky. Needs special hooks. t/slabs-reassign-chunked.t .. ok t/slabs-reassign2.t ......... ok t/slabs_reassign.t .......... ok t/ssl_cert_refresh.t ........ skipped: SSL testing is not enabled t/ssl_ports.t ............... skipped: SSL testing is not enabled t/ssl_session_resumption.t .. skipped: SSL testing is not enabled t/ssl_settings.t ............ skipped: SSL testing is not enabled t/ssl_verify_modes.t ........ skipped: SSL testing is not enabled PORT: 36981 t/stats-conns.t ............. ok t/stats-detail.t ............ ok t/stats.t ................... ok t/strtol-testing.t .......... ok t/touch.t ................... ok t/udp.t ..................... ok t/unixsocket.t .............. ok t/watcher.t ................. ok t/watcher_connid.t .......... ok t/whitespace.t .............. skipped: Skipping test because this does not appear to be a memcached git working directory Test Summary Report ------------------- t/idle-timeout.t (Wstat: 512 Tests: 11 Failed: 2) Failed tests: 10-11 Non-zero exit status: 2 Files=79, Tests=104595, 512 wallclock secs (31.65 usr 1.06 sys + 68.10 cusr 11.23 csys = 112.04 CPU) Result: FAIL make: *** [Makefile:2299: test] Error 1 ```
tianon commented 4 years ago

cc @dormando

I'm honestly really surprised that these two are the only failures (amd64, arm32v5, arm32v6, arm32v7, arm64v8, ppc64le, and s390x all completely successful), since i386 and mips64le don't really have very much in common as far as I know. :sweat_smile:

It looks like it's probably something small, maybe just a bug in the tests? (hopefully not something deeper)

tianon commented 4 years ago

I can't reproduce locally on my fast, multi-core amd64 machine using an i386 userspace, so maybe we've found what i386 and mips64le have in common -- they're both slow arches where timing issues will end up showing up more often? :sweat_smile:

I'm not sure what it is about 1.6.8 that makes this trigger more reliably either -- it seems to me like 1.6.8 shouldn't be related (reviewing the delta in https://github.com/memcached/memcached/compare/1.6.7...1.6.8), but I've got two build servers that have now retried the 1.6.8 build ~18 times each so far and say otherwise (but were happy on 1.6.7). :see_no_evil:

Edit: another interesting note is that 1.6.8-alpine succeeds on GitHub Actions, but fails on our official build server, lending more credence to a timing issue :thinking:

tianon commented 4 years ago

Oh, looking at https://github.com/docker-library/memcached/actions, it has been failing off-and-on within GitHub Actions since before 1.6.8, we just didn't notice the scheduled jobs were failing (and it was working fine on our official servers)!

tianon commented 4 years ago

Opened https://github.com/memcached/memcached/pull/729 to discuss this closer to home. :sweat_smile:

dormando commented 4 years ago

just idle-timeout or did you ever get watcher.t to fail?

tianon commented 4 years ago

Looking at the logs for i386 across three retries (3 attempted builds each), it's t/watcher.t ................. ok every time. :sweat_smile:

Also hilariously, after enough tries, they both partially succeeded, but it was racy for sure (so we're looking forward to https://github.com/memcached/memcached/commit/c0a2da219d6ae9477ee31e9214b3d973d26b5783 and can consider this "closed" from our perspective). :smile:

Also, in making https://github.com/memcached/memcached/pull/729 I noticed that the Makefile supports PARALLEL for make test (and passes it along to prove appropriately), so we'll be adding that which should help with overall image build time on the faster/beefer builders. :metal:

Edit: just double-checked some of the mips64le builds we have logs for and across 10 retries (3 attempted builds each), it was also always successful on watcher.t. :+1:

tianon commented 4 years ago

(Thanks for your help, and your work, as always! :+1:)

dormando commented 4 years ago

I just fixed the issue with watcher.t separately, fwiw