Skip every test suite if MIM is not running #4426
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The hook would check if MIM is running before init_per_suite for each big test It would check it for nodes requested by setting TEST_HOSTS variable --one-node flag still works as expected To disable this check use new --skip-validate-nodes flag It is compatible with cth_surefire
|
elasticsearch_and_cassandra_27 / elasticsearch_and_cassandra_mnesia / 42c3067 small_tests_27 / small_tests / 42c3067 small_tests_26 / small_tests / 42c3067 small_tests_27_arm64 / small_tests / 42c3067 ldap_mnesia_26 / ldap_mnesia / 42c3067 ldap_mnesia_27 / ldap_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}dynamic_domains_mysql_redis_27 / mysql_redis / 42c3067 sm_SUITE:tcp_tests:ping_timeout{error,{{badmatch,false},
[{escalus_session,stream_resumption,2,
[{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_session.erl"},
{line,259}]},
{escalus_connection,connection_step,2,
[{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"},
{line,161}]},
{lists,foldl_1,3,[{file,"lists.erl"},{line,2151}]},
{escalus_connection,start,2,
[{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"},
{line,145}]},
{sm_helper,connect_spec,3,
[{file,"/home/circleci/project/big_tests/tests/sm_helper.erl"},
{line,156}]},
{sm_SUITE,ping_timeout,1,
[{file,"/home/circleci/project/big_tests/tests/sm_SUITE.erl"},
{line,710}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1303}]}]}}dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 42c3067 dynamic_domains_pgsql_mnesia_27 / pgsql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}internal_mnesia_27 / internal_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}dynamic_domains_mssql_mnesia_27 / odbc_mssql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}inbox_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}pgsql_cets_27 / pgsql_cets / 42c3067 pgsql_mnesia_26 / pgsql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}mysql_redis_27 / mysql_redis / 42c3067 cockroachdb_cets_27 / cockroachdb_cets / 42c3067 pubsub_SUITE:dag+basic:subscribe_unsubscribe_test{error,
{timeout_when_waiting_for_stanza,
[{escalus_client,wait_for_stanza,
[{client,
<<"alice_subscribe_unsubscribe_test_3077@localhost/res1">>,
escalus_tcp,<0.108756.0>,
[{event_manager,<0.108624.0>},
{server,<<"localhost">>},
{username,<<"alicE_subscribe_unsubscribe_test_3077">>},
{resource,<<"res1">>}],
[{event_client,
[{event_manager,<0.108624.0>},
{server,<<"localhost">>},
{username,<<"alicE_subscribe_unsubscribe_test_3077">>},
{resource,<<"res1">>}]},
{resource,<<"res1">>},
{username,<<"alice_subscribe_unsubscribe_test_3077">>},
{server,<<"localhost">>},
{host,<<"localhost">>},
{port,5222},
{auth,{escalus_auth,auth_plain}},
{wspath,undefined},
{username,<<"alicE_subscribe_unsubscribe_test_3077">>},
{server,<<"localhost">>},
{password,<<"matygrysa">>},
{stream_id,<<"f6f7faacbf7482d8">>}]},
5000],
[{file,
"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
{line,136}]},
{pubsub_tools,receive_response,3,
[{file,"/home/circleci/project/big_tests/tests/pubsub_tools.erl"},
{line,433}]},
{pubsub_tools,receive_and_check_response,4,
[{file,"/home/circleci/project/big_tests/tests/pubsub_tools.erl"},
{line,424}]},
{pu...mssql_mnesia_27 / odbc_mssql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}inbox_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}ldap_mnesia_27 / ldap_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}dynamic_domains_mysql_redis_27 / mysql_redis / 42c3067 internal_mnesia_27 / internal_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}dynamic_domains_mssql_mnesia_27 / odbc_mssql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}inbox_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}rest_client_SUITE:roster:add_contact_and_be_invited{error,
{timeout_when_waiting_for_stanza,
[{escalus_client,wait_for_stanza,
[{client,
<<"[email protected]/res1">>,
escalus_tcp,<0.111419.0>,
[{event_manager,<0.111408.0>},
{server,<<"domain.example.com">>},
{username,<<"alicE_add_contact_and_be_invited_3008">>},
{resource,<<"res1">>}],
[{event_client,
[{event_manager,<0.111408.0>},
{server,<<"domain.example.com">>},
{username,<<"alicE_add_contact_and_be_invited_3008">>},
{resource,<<"res1">>}]},
{resource,<<"res1">>},
{username,<<"alice_add_contact_and_be_invited_3008">>},
{server,<<"domain.example.com">>},
{host,<<"localhost">>},
{port,5222},
{auth,{escalus_auth,auth_plain}},
{wspath,undefined},
{username,<<"alicE_add_contact_and_be_invited_3008">>},
{server,<<"domain.example.com">>},
{host,<<"localhost">>},
{password,<<"matygrysa">>},
{stream_id,<<"cc6fa3c2a24c07c3">>}]},
5000],
[{file,
"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
{line,136}]},
{rest_client_SUITE,'-add_contact_and_be_invited/1-fun-1-',2,
[{file,
"/home/circleci/project/big_tests/tests/rest_client_SUITE.erl"},
{line,1280}]},
{escalus_story,story,4,
...sasl_external_SUITE:just_tls:self_signed:self_signed_certs_allowed:init_per_group{'EXIT',
{{badmatch,
{error,
{bad_return,
{{ejabberd_app,start,[normal,[]]},
{'EXIT',
{timeout,
{gen_server,call,
[mongoose_wpool_rdbms_mgr,
{start_pool,global,default,
[{workers,5}],
#{driver => odbc,query_timeout => 5000,
max_start_interval => 30,
settings =>
"DSN=mongoose-mssql;UID=sa;PWD=mongooseim_secret+ESL123"}}]}}}}}}},
[{ejabberd_node_utils,restart_application,2,
[{file,
"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,79}]},
{sasl_external_SUITE,init_per_group,2,
[{file,
"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,138}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:self_signed:standard:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,117}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:self_signed:standard_keep_auth:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,121}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:self_signed:use_common_name:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,129}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:self_signed:allow_just_user_identity:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,132}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:self_signed:demo_verification_module:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,135}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:self_signed_certs_not_allowed:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,141}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:standard:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,117}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:standard_keep_auth:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,121}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:use_common_name:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,129}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:allow_just_user_identity:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,132}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:just_tls:ca_signed:demo_verification_module:init_per_group{'EXIT',{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,init_per_group,2,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,135}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}sasl_external_SUITE:end_per_suite{error,{{badmatch,{error,{not_started,mongooseim}}},
[{ejabberd_node_utils,restart_application,2,
[{file,"/home/circleci/project/big_tests/tests/ejabberd_node_utils.erl"},
{line,78}]},
{sasl_external_SUITE,end_per_suite,1,
[{file,"/home/circleci/project/big_tests/tests/sasl_external_SUITE.erl"},
{line,101}]},
{test_server,ts_tc,3,[{file,"test_server.erl"},{line,1794}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1391}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}service_domain_db_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}service_mongoose_system_metrics_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}sic_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}sm_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}system_probes_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}vcard_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}vcard_simple_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}websockets_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim@localhost}]}8 errors were truncated dynamic_domains_pgsql_mnesia_27 / pgsql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}inbox_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}inbox_extensions_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}pgsql_mnesia_26 / pgsql_mnesia / 42c3067 graphql_metric_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim3@localhost}]}mssql_mnesia_27 / odbc_mssql_mnesia / 42c3067 |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #4426 +/- ##
==========================================
+ Coverage 84.96% 85.40% +0.44%
==========================================
Files 549 549
Lines 33861 33861
==========================================
+ Hits 28770 28919 +149
+ Misses 5091 4942 -149 ☔ View full report in Codecov by Sentry. |
|
elasticsearch_and_cassandra_27 / elasticsearch_and_cassandra_mnesia / ebc3c1b small_tests_26 / small_tests / ebc3c1b small_tests_27 / small_tests / ebc3c1b small_tests_27_arm64 / small_tests / ebc3c1b |
If it is restartating at the end of the test suite If MIM is restarted asynchronously, simple checking if application is running is not enough. We first need to wait for MIM to actually fully restart. The best place to do it is in end_per_suite. So, if some suite crashes MIM, the rest of suites would quickly fail in init_per_suite (and we need to wait only once)
arcusfelis
force-pushed
the
cth-validate-nodes
branch
from
ebc3c1b to
fa9a11e
Compare
|
elasticsearch_and_cassandra_27 / elasticsearch_and_cassandra_mnesia / fa9a11e small_tests_26 / small_tests / fa9a11e small_tests_27 / small_tests / fa9a11e small_tests_27_arm64 / small_tests / fa9a11e ldap_mnesia_26 / ldap_mnesia / fa9a11e ldap_mnesia_27 / ldap_mnesia / fa9a11e service_mongoose_system_metrics_SUITE:all_clustered_mongooses_report_the_same_client_id{skip,
{failed,
{service_mongoose_system_metrics_SUITE,init_per_testcase,
{{badrpc,timeout},
[{distributed_helper,rpc,
[#{timeout => 30000,node => mongooseim2@localhost},
mongoose_cluster,join,
[mongooseim@localhost]],
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,140}]},
{distributed_helper,add_node_to_mnesia_cluster,2,
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,44}]},
{distributed_helper,add_node_to_cluster,2,
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,36}]},
{service_mongoose_system_metrics_SUITE,init_per_testcase,2,
[{file,
"/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
{line,113}]},
{test_server,do_init_per_testcase,2,
[{file,"test_server.erl"},{line,1564}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1265}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}}}shared_roster_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}sic_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}sm_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}system_probes_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}vcard_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}vcard_simple_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}websockets_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}xep_0352_csi_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}service_domain_db_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}domain_isolation_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}domain_removal_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}dynamic_domains_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}local_iq_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}tcp_listener_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}cets_disco_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}start_node_id_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}tr_util_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}shutdown_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}dynamic_domains_mysql_redis_27 / mysql_redis / fa9a11e internal_mnesia_27 / internal_mnesia / fa9a11e dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / fa9a11e dynamic_domains_pgsql_mnesia_27 / pgsql_mnesia / fa9a11e dynamic_domains_mssql_mnesia_27 / odbc_mssql_mnesia / fa9a11e pgsql_cets_27 / pgsql_cets / fa9a11e cockroachdb_cets_27 / cockroachdb_cets / fa9a11e mysql_redis_27 / mysql_redis / fa9a11e pgsql_mnesia_27 / pgsql_mnesia / fa9a11e pgsql_mnesia_26 / pgsql_mnesia / fa9a11e mssql_mnesia_27 / odbc_mssql_mnesia / fa9a11e ldap_mnesia_27 / ldap_mnesia / fa9a11e service_mongoose_system_metrics_SUITE:all_clustered_mongooses_report_the_same_client_id{skip,
{failed,
{service_mongoose_system_metrics_SUITE,init_per_testcase,
{{badrpc,timeout},
[{distributed_helper,rpc,
[#{timeout => 30000,node => mongooseim2@localhost},
mongoose_cluster,join,
[mongooseim@localhost]],
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,140}]},
{distributed_helper,add_node_to_mnesia_cluster,2,
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,44}]},
{distributed_helper,add_node_to_cluster,2,
[{file,
"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
{line,36}]},
{service_mongoose_system_metrics_SUITE,init_per_testcase,2,
[{file,
"/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
{line,113}]},
{test_server,do_init_per_testcase,2,
[{file,"test_server.erl"},{line,1564}]},
{test_server,run_test_case_eval1,6,
[{file,"test_server.erl"},{line,1265}]},
{test_server,run_test_case_eval,9,
[{file,"test_server.erl"},{line,1235}]}]}}}}shared_roster_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}sic_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}sm_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}system_probes_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}vcard_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}vcard_simple_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}websockets_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}xep_0352_csi_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}service_domain_db_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}domain_isolation_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}domain_removal_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}dynamic_domains_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}local_iq_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}tcp_listener_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}cets_disco_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}start_node_id_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}tr_util_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}shutdown_SUITE:init_per_suite{fail,[{validate_node_failed,mongooseim_not_running,mongooseim2@localhost}]}ldap_mnesia_27 / ldap_mnesia / fa9a11e |
chrzaszcz
approved these changes
Dec 11, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR addresses MIM-2329.
Proposed changes include:
Add cth_validate_nodes hook
The hook would check if MIM is running before init_per_suite for each big test
It would check it for nodes requested by setting TEST_HOSTS variable
--one-node flag still works as expected
To disable this check use new --skip-validate-nodes flag
It is compatible with cth_surefire
We added an extra
wait_until, so we handle the case like that:https://esl.github.io/html-zip-reader/PR/4426/248490/pgsql_mnesia.26.2.5.4-amd64/big.tar.gz//[email protected]_14.59.14/index.html
mim3 is not available initially, but after a couple of skipped suites it is available again. We wait in post_end_per_suite.