search

couchbaselabs / mobile-testkit

Mobile QE Test Framework
15 stars 12 forks source link

Certain functional tests fail sporadically #1185

Open tleyden opened 7 years ago

tleyden commented 7 years ago

test_server_goes_down_rebuild_channels

This is testing https://github.com/couchbase/sync_gateway/commit/a0409e963bbe9fd2a6854de1f2d74c84e6d11a1e, but I suspect it might be the same situation on the master branch.

I'm documenting it in case other folks run into it as well.

Another fail/pass round on same commit:

test_log_200mb[log_rotation]

test_dcp_reshard_single_sg_accel_goes_down_and_up[resources/sync_gateway_configs/sync_gateway_default_functional_tests_di.json]

test_continuous_changes_parametrized[sync_gateway_default_functional_tests_revslimit50-50-50-1000]

test_user_views_sanity[user_views/user_views]

tleyden commented 7 years ago

test_server_goes_down_rebuild_channels

Another fail/pass round on same commit:

tleyden commented 7 years ago

test_dcp_reshard_single_sg_accel_goes_down_and_up[resources/sync_gateway_configs/sync_gateway_default_functional_tests_di.json]

tleyden commented 7 years ago

@sethrosetter check this comment -- was against server 4.x: https://github.com/couchbaselabs/mobile-testkit/issues/1185#issuecomment-300922133

sethrosetter commented 7 years ago

test_server_goes_down_rebuild_channels is most likely due to this - https://github.com/couchbase/sync_gateway/issues/2576 (Regression with failover handling and DCP)

tleyden commented 7 years ago

test_continuous_changes_parametrized[sync_gateway_default_functional_tests_revslimit50-50-50-1000]

tleyden commented 7 years ago

Regarding https://github.com/couchbaselabs/mobile-testkit/issues/1185#issuecomment-302824145, in test cen7-sync-gateway-functional-tests-base-di/544 it looks like the python VM may have crashed:

https://gist.github.com/tleyden/e4be44a026c06bad2795776514c162d1

tleyden commented 7 years ago

test_user_views_sanity[user_views/user_views]