Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instrument/unit test #4227

Merged
merged 4 commits into from
Feb 22, 2024
Merged

Conversation

chrzaszcz
Copy link
Member

@chrzaszcz chrzaszcz commented Feb 20, 2024

Add unit tests for mongoose_instrument and fix minor error-handling issues revealed by the tests.

The tests capture the current state, i.e.

  • Prometheus metrics are created but not initialized. We could decide to initialize them, and do it in a separate PR.
  • The label-related inconsistencies will be addressed separately in a subsequent PR.

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from aadab1a to 745e5e4 Compare February 20, 2024 14:45
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 20, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / aadab1a
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_26 / small_tests / aadab1a
Reports root / small


dynamic_domains_mysql_redis_26 / mysql_redis / aadab1a
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / aadab1a
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / aadab1a
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / aadab1a
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / aadab1a
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / aadab1a
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

graphql_muc_light_SUITE:admin_http:admin_muc_light:end_per_group
{error,
 {{unregistering_failed,
   {amount,3},
   {unregistered_items,
  [{{<<"_admin_send_message_to_room_1042">>,
     [{escalus_event_mgr,<0.23754.0>},
    {tc_name,admin_send_message_to_room},
    {escalus_cleaner,<0.23753.0>},
    {watchdog,<0.23752.0>},
    {muc_light_host,<<"muclight.domain.example.com">>},
    {secondary_muc_light_host,<<"muclight.domain.example.org">>},
    {protocol,http},
    {schema_endpoint,admin},
    {listener_opts,
     #{module => mongoose_graphql_handler,path => "/api/graphql",
       host => "localhost",username => <<"admin">>,
       password => <<"secret">>,sse_idle_timeout => 3600000,
       schema_endpoint => admin}},
    {{ejabberd_cwd,mongooseim@localhost},
     "/home/circleci/project/_build/mim1/rel/mongooseim"},
    {preset,"odbc_mssql_mnesia"},
    {mim_data_dir,
     "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE_data"},
    {tc_logfile,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208096/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4042a5c359bb95.2024-02-20_14.49.22/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-02-20_14.53.21/graphql_muc_light_suite.admin_send_message_to_room.html"},
    {tc_group_properties,[{name,admin_muc_light}]},
    {tc_group_path,[[{name,admin_http}]]},
    {data_dir,
     "/home/circleci/project/big_tests/_build/default/lib/mongoose_tests/ebin/graphql_muc_light_SUITE_data/"},
    {priv_dir,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208096/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%4042a5c359bb95.2024-02-20_14.49.22/big_tests.tests.graphql_muc_light...

Report log


mysql_redis_26 / mysql_redis / aadab1a
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / aadab1a
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / aadab1a
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 20, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 745e5e4
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / 745e5e4
Reports root / small


small_tests_26 / small_tests / 745e5e4
Reports root / small


small_tests_26_arm64 / small_tests / 745e5e4
Reports root / small


ldap_mnesia_25 / ldap_mnesia / 745e5e4
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 745e5e4
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / 745e5e4
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 745e5e4
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / 745e5e4
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 745e5e4
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / 745e5e4
Reports root/ big
OK: 2414 / Failed: 1 / User-skipped: 716 / Auto-skipped: 0

pubsub_SUITE:dag+basic:publish_only_retract_items_scope_test
{error,{{badmatch,false},
    [{pubsub_tools,check_response,2,
             [{file,"/home/circleci/project/big_tests/tests/pubsub_tools.erl"},
            {line,444}]},
     {pubsub_tools,receive_response,3,
             [{file,"/home/circleci/project/big_tests/tests/pubsub_tools.erl"},
            {line,434}]},
     {pubsub_tools,receive_and_check_response,4,
             [{file,"/home/circleci/project/big_tests/tests/pubsub_tools.erl"},
            {line,424}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 745e5e4
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / 745e5e4
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 745e5e4
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / 745e5e4
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / 745e5e4
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

Copy link

codecov bot commented Feb 20, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (eb17e73) 84.21% compared to head (6cedfb1) 84.42%.

Additional details and impacted files
@@                  Coverage Diff                   @@
##           feature/instrument    #4227      +/-   ##
======================================================
+ Coverage               84.21%   84.42%   +0.20%     
======================================================
  Files                     557      557              
  Lines                   33582    33588       +6     
======================================================
+ Hits                    28281    28356      +75     
+ Misses                   5301     5232      -69     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from 745e5e4 to a3aea9a Compare February 20, 2024 14:55
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 20, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / a3aea9a
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / a3aea9a
Reports root / small


small_tests_26 / small_tests / a3aea9a
Reports root / small


small_tests_26_arm64 / small_tests / a3aea9a
Reports root / small


ldap_mnesia_25 / ldap_mnesia / a3aea9a
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / a3aea9a
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / a3aea9a
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / a3aea9a
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / a3aea9a
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / a3aea9a
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / a3aea9a
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / a3aea9a
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / a3aea9a
Reports root/ big
OK: 4828 / Failed: 1 / User-skipped: 118 / Auto-skipped: 0

jingle_SUITE:all:resp_4xx_from_sip_proxy_results_in_session_terminate
{error,
  {{assertion_failed,assert,is_iq_result,
     {xmlel,<<"iq">>,
       [{<<"from">>,<<"error.480@localhost">>},
        {<<"to">>,
         <<"alice_resp_4xx_from_sip_proxy_results_in_session_terminate_1645@localhost/res1">>},
        {<<"id">>,<<"9dafb3a7-7052-402d-962d-25517433e42b">>},
        {<<"type">>,<<"set">>}],
       [{xmlel,<<"jingle">>,
          [{<<"xmlns">>,<<"urn:xmpp:jingle:1">>},
           {<<"action">>,<<"session-terminate">>},
           {<<"sid">>,<<"99f5e6e4-188b-44b3-a042-35a346d574ad">>}],
          [{xmlel,<<"reason">>,[],
             [{xmlel,<<"general-error">>,[],[]},
            {xmlel,<<"sip-error">>,
              [{<<"code">>,<<"480">>}],
              [{xmlcdata,<<"Temporarily Unavailable">>}]}]}]}]},
     "<iq from='error.480@localhost' to='alice_resp_4xx_from_sip_proxy_results_in_session_terminate_1645@localhost/res1' id='9dafb3a7-7052-402d-962d-25517433e42b' type='set'><jingle xmlns='urn:xmpp:jingle:1' action='session-terminate' sid='99f5e6e4-188b-44b3-a042-35a346d574ad'><reason><general-error/><sip-error code='480'>Temporarily Unavailable</sip-error></reason></jingle></iq>"},
   [{escalus_new_assert,assert_true,2,
      [{file,
         "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_new_assert.erl"},
       {line,84}]},
    {jingle_SUITE,send_initiate_and_wait_for_first_iq_set,2,
      [{file,"/home/circleci/project/big_tests/tests/jingle_SUITE.erl"},
       {line,390}]},
    {jingle_SUITE,
      '-resp_...

Report log


mysql_redis_26 / mysql_redis / a3aea9a
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / a3aea9a
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / a3aea9a
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from a3aea9a to 6a1225d Compare February 20, 2024 15:16
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 20, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 6a1225d
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / 6a1225d
Reports root / small


small_tests_26 / small_tests / 6a1225d
Reports root / small


small_tests_26_arm64 / small_tests / 6a1225d
Reports root / small


ldap_mnesia_25 / ldap_mnesia / 6a1225d
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 6a1225d
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / 6a1225d
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 6a1225d
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / 6a1225d
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / 6a1225d
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 6a1225d
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 6a1225d
Reports root/ big
OK: 4417 / Failed: 1 / User-skipped: 114 / Auto-skipped: 0

graphql_muc_light_SUITE:admin_cli:admin_muc_light:end_per_group
{error,
 {{unregistering_failed,
   {amount,1},
   {unregistered_items,
  [{{<<"_admin_send_message_to_room_errors_1072">>,
     [{escalus_event_mgr,<0.24348.0>},
    {tc_name,admin_send_message_to_room_errors},
    {escalus_cleaner,<0.24347.0>},
    {watchdog,<0.24346.0>},
    {muc_light_host,<<"muclight.domain.example.com">>},
    {secondary_muc_light_host,<<"muclight.domain.example.org">>},
    {protocol,cli},
    {schema_endpoint,admin},
    {{ejabberd_cwd,mongooseim@localhost},
     "/home/circleci/project/_build/mim1/rel/mongooseim"},
    {preset,"odbc_mssql_mnesia"},
    {mim_data_dir,
     "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE_data"},
    {tc_logfile,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208174/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%40f5eb0b281e5c.2024-02-20_15.21.26/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-02-20_15.25.49/graphql_muc_light_suite.admin_send_message_to_room_errors.47490.html"},
    {tc_group_properties,[{name,admin_muc_light}]},
    {tc_group_path,[[{name,admin_cli}]]},
    {data_dir,
     "/home/circleci/project/big_tests/_build/default/lib/mongoose_tests/ebin/graphql_muc_light_SUITE_data/"},
    {priv_dir,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208174/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%40f5eb0b281e5c.2024-02-20_15.21.26/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-02-20_15.25.49/log_private/"},
    {{saved_modules,mongooseim@localhost,<<"test type">>},
     #{mod_vcard =>
      #{matches => 30,
        host => {prefix,<<"vjud.">>},
        search =>...

Report log

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {{badmatch,null},
   [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1155}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log


mysql_redis_26 / mysql_redis / 6a1225d
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / 6a1225d
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 6a1225d
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / 6a1225d
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 6a1225d
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from 6a1225d to e90d778 Compare February 21, 2024 13:50
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 21, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / e90d778
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / e90d778
Reports root / small


small_tests_26 / small_tests / e90d778
Reports root / small


small_tests_26_arm64 / small_tests / e90d778
Reports root / small


ldap_mnesia_25 / ldap_mnesia / e90d778
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / e90d778
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / e90d778
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / e90d778
Reports root/ big
OK: 4387 / Failed: 1 / User-skipped: 144 / Auto-skipped: 0

carboncopy_SUITE:one2one:dropped_client_doesnt_create_duplicate_carbons
{error,
  {{badmatch,
     [{xmlel,<<"message">>,
        [{<<"from">>,
        <<"alice_dropped_client_doesnt_create_duplicate_carbons_592@domain.example.com">>},
         {<<"to">>,
        <<"alice_dropped_client_doesnt_create_duplicate_carbons_592@domain.example.com/res2">>},
         {<<"xmlns">>,<<"jabber:client">>},
         {<<"type">>,<<"chat">>}],
        [{xmlel,<<"sent">>,
           [{<<"xmlns">>,<<"urn:xmpp:carbons:2">>}],
           [{xmlel,<<"forwarded">>,
            [{<<"xmlns">>,<<"urn:xmpp:forward:0">>}],
            [{xmlel,<<"message">>,
               [{<<"from">>,
                 <<"alice_dropped_client_doesnt_create_duplicate_carbons_592@domain.example.com/res1">>},
                {<<"type">>,<<"chat">>},
                {<<"to">>,
                 <<"bob_dropped_client_doesnt_create_duplicate_carbons_592@domain.example.com/res1">>},
                {<<"xmlns">>,<<"jabber:client">>}],
               [{xmlel,<<"body">>,[],
                  [{xmlcdata,
                     <<"And pious action">>}]}]}]}]}]}]},
   [{carboncopy_SUITE,
      '-dropped_client_doesnt_create_duplicate_carbons/1-fun-0-',4,
      [{file,
         "/home/circleci/project/big_tests/tests/carboncopy_SUITE.erl"},
       {line,189}]},
    {escalus_story,story,4,
      [{file,
         "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
       {line,72}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_c...

Report log


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / e90d778
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / e90d778
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / e90d778
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / e90d778
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / e90d778
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / e90d778
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / e90d778
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / e90d778
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from e90d778 to 10f8c64 Compare February 21, 2024 14:25
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 21, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 10f8c64
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / 10f8c64
Reports root / small


small_tests_26 / small_tests / 10f8c64
Reports root / small


small_tests_26_arm64 / small_tests / 10f8c64
Reports root / small


ldap_mnesia_26 / ldap_mnesia / 10f8c64
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 10f8c64
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / 10f8c64
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 10f8c64
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 10f8c64
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 10f8c64
Reports root/ big
OK: 4417 / Failed: 1 / User-skipped: 114 / Auto-skipped: 0

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {{badmatch,null},
   [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1155}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log


mysql_redis_26 / mysql_redis / 10f8c64
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / 10f8c64
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 10f8c64
Reports root/ big
OK: 4809 / Failed: 1 / User-skipped: 118 / Auto-skipped: 0

graphql_server_SUITE:admin_cli:clustering_tests:remove_dead_from_cluster
{error,{{have_node_in_mnesia,true,[{times,60,false}],ok},
    [{mongoose_helper,do_wait_until,2,
              [{file,"/home/circleci/project/big_tests/../test/common/mongoose_helper.erl"},
               {line,359}]},
     {graphql_server_SUITE,remove_dead_from_cluster,1,
                 [{file,"/home/circleci/project/big_tests/tests/graphql_server_SUITE.erl"},
                {line,204}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


mssql_mnesia_26 / odbc_mssql_mnesia / 10f8c64
Reports root/ big
OK: 4805 / Failed: 2 / User-skipped: 121 / Auto-skipped: 0

graphql_muc_light_SUITE:admin_http:admin_muc_light:end_per_group
{error,
 {{unregistering_failed,
   {amount,1},
   {unregistered_items,
  [{{<<"_admin_get_room_config_1100">>,
     [{escalus_event_mgr,<0.24092.0>},
    {tc_name,admin_get_room_config},
    {escalus_cleaner,<0.24091.0>},
    {watchdog,<0.24090.0>},
    {muc_light_host,<<"muclight.localhost">>},
    {secondary_muc_light_host,<<"muclight.localhost.bis">>},
    {protocol,http},
    {schema_endpoint,admin},
    {listener_opts,
     #{module => mongoose_graphql_handler,path => "/api/graphql",
       host => "localhost",username => <<"admin">>,
       password => <<"secret">>,schema_endpoint => admin,
       sse_idle_timeout => 3600000}},
    {{ejabberd_cwd,mongooseim@localhost},
     "/home/circleci/project/_build/mim1/rel/mongooseim"},
    {preset,"odbc_mssql_mnesia"},
    {mim_data_dir,
     "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE_data"},
    {tc_logfile,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208345/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%401cca0b4fedf2.2024-02-21_14.30.23/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-02-21_14.35.35/graphql_muc_light_suite.admin_get_room_config.html"},
    {tc_group_properties,[{name,admin_muc_light}]},
    {tc_group_path,[[{name,admin_http}]]},
    {data_dir,
     "/home/circleci/project/big_tests/_build/default/lib/mongoose_tests/ebin/graphql_muc_light_SUITE_data/"},
    {priv_dir,
     "https://circleci-mim-results.s3.eu-central-1.amazonaws.com/PR/4227/208345/odbc_mssql_mnesia.26.1.2-amd64/big/ct_run.test%401cca0b4fedf2.2024-02-21_14.30.23/big_tests.tests.graphql_muc_light_SUITE.logs/run.2024-02-21_14...

Report log

graphql_muc_light_SUITE:admin_cli:admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {#{what => invalid_response_code,expected_type => ok,
     response_code => {exit_status,1}},
   [{graphql_helper,assert_response_code,2,
      [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
       {line,256}]},
    {graphql_helper,get_ok_value,2,
      [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
       {line,239}]},
    {graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1156}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {{badmatch,null},
   [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1155}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from 10f8c64 to 4e0cd6b Compare February 21, 2024 14:41
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 21, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 4e0cd6b
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / 4e0cd6b
Reports root / small


small_tests_26 / small_tests / 4e0cd6b
Reports root / small


small_tests_26_arm64 / small_tests / 4e0cd6b
Reports root / small


ldap_mnesia_25 / ldap_mnesia / 4e0cd6b
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 4e0cd6b
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / 4e0cd6b
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / 4e0cd6b
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 4e0cd6b
Reports root/ big
OK: 4420 / Failed: 1 / User-skipped: 111 / Auto-skipped: 0

sm_SUITE:ping_timeout
{error,{noproc,{gen_server,call,[<0.83854.0>,get_sm_h]}}}

Report log


internal_mnesia_26 / internal_mnesia / 4e0cd6b
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 4e0cd6b
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 4e0cd6b
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / 4e0cd6b
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 4e0cd6b
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / 4e0cd6b
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / 4e0cd6b
Reports root/ big
OK: 4788 / Failed: 1 / User-skipped: 139 / Auto-skipped: 0

sm_SUITE:ping_timeout
{error,
  {{badmatch,
     [{xmlel,<<"iq">>,
        [{<<"type">>,<<"error">>},
         {<<"to">>,<<"localhost">>},
         {<<"from">>,
        <<"alice_ping_timeout_3443@localhost/escalus-default-resource">>},
         {<<"id">>,<<"cfd456a1cf8365fa">>}],
        [{xmlel,<<"ping">>,[{<<"xmlns">>,<<"urn:xmpp:ping">>}],[]},
         {xmlel,<<"error">>,
           [{<<"code">>,<<"503">>},{<<"type">>,<<"cancel">>}],
           [{xmlel,<<"service-unavailable">>,
            [{<<"xmlns">>,
              <<"urn:ietf:params:xml:ns:xmpp-stanzas">>}],
            []},
          {xmlel,<<"text">>,
            [{<<"xmlns">>,
              <<"urn:ietf:params:xml:ns:xmpp-stanzas">>}],
            [{xmlcdata,<<"Route offline">>}]}]}]},
      {xmlel,<<"iq">>,
        [{<<"type">>,<<"error">>},
         {<<"to">>,<<"localhost">>},
         {<<"from">>,
        <<"alice_ping_timeout_3443@localhost/escalus-default-resource">>},
         {<<"id">>,<<"ce7eec69940a1441">>}],
        [{xmlel,<<"ping">>,[{<<"xmlns">>,<<"urn:xmpp:ping">>}],[]},
         {xmlel,<<"error">>,
           [{<<"code">>,<<"503">>},{<<"type">>,<<"cancel">>}],
           [{xmlel,<<"service-unavailable">>,
            [{<<"xmlns">>,
              <<"urn:ietf:params:xml:ns:xmpp-stanzas">>}],
            []},
          {xmlel,<<"text">>,
            [{<<"xmlns">>,
              <<"urn:ietf:params:xml:ns:xmpp-stanzas">>}],
            [{xmlcdata,<<"Route offline">>}]}]}]}]},
   [{sm_SUITE,ping_timeout,1,
      [{file,"/home/ci...

Report log

@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from 4e0cd6b to f679689 Compare February 22, 2024 07:51
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 22, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / f679689
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / f679689
Reports root / small


small_tests_26 / small_tests / f679689
Reports root / small


small_tests_26_arm64 / small_tests / f679689
Reports root / small


dynamic_domains_mysql_redis_26 / mysql_redis / f679689
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / f679689
Reports root/ big
OK: 2274 / Failed: 1 / User-skipped: 856 / Auto-skipped: 0

graphql_roster_SUITE:user_roster:user_invite_accept_and_cancel_subscription
{error,
  {timeout_when_waiting_for_stanza,
    [{escalus_client,wait_for_stanza,
       [{client,
          <<"bob_user_invite_accept_and_cancel_subscription_921@localhost/res1">>,
          escalus_tcp,<0.20638.0>,
          [{event_manager,<0.20636.0>},
           {server,<<"localhost">>},
           {username,
             <<"bOb_user_invite_accept_and_cancel_subscription_921">>},
           {resource,<<"res1">>}],
          [{event_client,
             [{event_manager,<0.20636.0>},
            {server,<<"localhost">>},
            {username,
              <<"bOb_user_invite_accept_and_cancel_subscription_921">>},
            {resource,<<"res1">>}]},
           {resource,<<"res1">>},
           {username,
             <<"bob_user_invite_accept_and_cancel_subscription_921">>},
           {server,<<"localhost">>},
           {host,<<"localhost">>},
           {port,5222},
           {auth,{escalus_auth,auth_plain}},
           {wspath,undefined},
           {username,
             <<"bOb_user_invite_accept_and_cancel_subscription_921">>},
           {server,<<"localhost">>},
           {password,<<"makrolika">>},
           {stream_id,<<"235161aa7cc548bf">>}]},
        1],
       [{file,
          "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_client.erl"},
        {line,136}]},
     {graphql_roster_SUITE,
       user_invite_accept_and_cancel_subscription_story,3,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_roster_SUITE...

Report log


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / f679689
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


ldap_mnesia_25 / ldap_mnesia / f679689
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / f679689
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / f679689
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / f679689
Reports root/ big
OK: 2404 / Failed: 4 / User-skipped: 591 / Auto-skipped: 132

graphql_server_SUITE:admin_cli:clustering_tests:remove_alive_from_cluster
{error,{{badrpc,nodedown},
    [{distributed_helper,rpc,
               [#{timeout => 60000,
                node => mongooseim3@localhost},
                mongoose_cluster,join,
                [mongooseim@localhost]],
               [{file,"/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
                {line,140}]},
     {graphql_server_SUITE,remove_alive_from_cluster,1,
                 [{file,"/home/circleci/project/big_tests/tests/graphql_server_SUITE.erl"},
                {line,214}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_server_SUITE:admin_cli:clustering_tests:remove_node_test
{error,{#{what => invalid_response_code,expected_type => ok,
      response_code => {exit_status,3}},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,256}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,239}]},
     {graphql_server_SUITE,remove_node_test,1,
                 [{file,"/home/circleci/project/big_tests/tests/graphql_server_SUITE.erl"},
                {line,225}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_server_SUITE:admin_cli:clustering_tests:stop_node_test
{error,{#{what => invalid_response_code,expected_type => ok,
      response_code => {exit_status,3}},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,256}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,239}]},
     {graphql_server_SUITE,stop_node_test,1,
                 [{file,"/home/circleci/project/big_tests/tests/graphql_server_SUITE.erl"},
                {line,230}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

service_mongoose_system_metrics_SUITE:log_transparency:just_removed_from_config_logs_question
{error,
  {{badrpc,nodedown},
   [{distributed_helper,rpc,
      [#{node => mongooseim3@localhost},
       mongoose_service,ensure_stopped,
       [service_mongoose_system_metrics]],
      [{file,
         "/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
       {line,140}]},
    {service_mongoose_system_metrics_SUITE,disable_system_metrics,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       {line,437}]},
    {service_mongoose_system_metrics_SUITE,
      just_removed_from_config_logs_question,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_mongoose_system_metrics_SUITE.erl"},
       {line,283}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

service_domain_db_SUITE:init_per_suite
{'EXIT',
  {{badrpc,nodedown},
   [{distributed_helper,rpc,
      [#{node => mongooseim3@localhost},
       mongoose_service,loaded_services_with_opts,[]],
      [{file,
         "/home/circleci/project/big_tests/../test/common/distributed_helper.erl"},
       {line,140}]},
    {dynamic_services,save_services,2,
      [{file,
         "/home/circleci/project/big_tests/tests/dynamic_services.erl"},
       {line,15}]},
    {lists,foldl_1,3,[{file,"lists.erl"},{line,1599}]},
    {service_domain_db_SUITE,init_per_suite,1,
      [{file,
         "/home/circleci/project/big_tests/tests/service_domain_db_SUITE.erl"},
       {line,198}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1390}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / f679689
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / f679689
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / f679689
Reports root/ big
OK: 4809 / Failed: 1 / User-skipped: 118 / Auto-skipped: 0

sm_SUITE:ping_timeout
{error,{noproc,{gen_server,call,[<0.94834.0>,get_sm_h]}}}

Report log


mysql_redis_26 / mysql_redis / f679689
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / f679689
Reports root/ big
OK: 4805 / Failed: 2 / User-skipped: 121 / Auto-skipped: 0

graphql_muc_light_SUITE:admin_cli:admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {#{what => invalid_response_code,expected_type => ok,
     response_code => {exit_status,1}},
   [{graphql_helper,assert_response_code,2,
      [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
       {line,256}]},
    {graphql_helper,get_ok_value,2,
      [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
       {line,239}]},
    {graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1156}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_muc_light_SUITE:domain_admin:domain_admin_muc_light:admin_create_room_with_unprepped_id
{error,
  {{badmatch,null},
   [{graphql_muc_light_SUITE,admin_create_room_with_unprepped_id,1,
      [{file,
         "/home/circleci/project/big_tests/tests/graphql_muc_light_SUITE.erl"},
       {line,1155}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

- Make sure double attach causes an error
- Make errors more meaningful
Use mocked handlers, because specific ones will be tested separately.
@chrzaszcz chrzaszcz force-pushed the instrument/unit-test branch from f679689 to 6cedfb1 Compare February 22, 2024 07:58
@mongoose-im
Copy link
Collaborator

mongoose-im commented Feb 22, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 6cedfb1
Reports root/ big
OK: 417 / Failed: 0 / User-skipped: 43 / Auto-skipped: 0


small_tests_25 / small_tests / 6cedfb1
Reports root / small


small_tests_26 / small_tests / 6cedfb1
Reports root / small


small_tests_26_arm64 / small_tests / 6cedfb1
Reports root / small


ldap_mnesia_25 / ldap_mnesia / 6cedfb1
Reports root/ big
OK: 2274 / Failed: 1 / User-skipped: 856 / Auto-skipped: 0

graphql_server_SUITE:admin_cli:clustering_tests:remove_dead_from_cluster
{error,{{have_node_in_mnesia,true,[{times,60,false}],ok},
    [{mongoose_helper,do_wait_until,2,
              [{file,"/home/circleci/project/big_tests/../test/common/mongoose_helper.erl"},
               {line,359}]},
     {graphql_server_SUITE,remove_dead_from_cluster,1,
                 [{file,"/home/circleci/project/big_tests/tests/graphql_server_SUITE.erl"},
                {line,204}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log


dynamic_domains_mysql_redis_26 / mysql_redis / 6cedfb1
Reports root/ big
OK: 4388 / Failed: 0 / User-skipped: 144 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 6cedfb1
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / 6cedfb1
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 6cedfb1
Reports root/ big
OK: 4421 / Failed: 0 / User-skipped: 111 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 6cedfb1
Reports root/ big
OK: 4356 / Failed: 0 / User-skipped: 178 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / 6cedfb1
Reports root/ big
OK: 2415 / Failed: 0 / User-skipped: 716 / Auto-skipped: 0


pgsql_mnesia_25 / pgsql_mnesia / 6cedfb1
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / 6cedfb1
Reports root/ big
OK: 4789 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 6cedfb1
Reports root/ big
OK: 4418 / Failed: 0 / User-skipped: 114 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 6cedfb1
Reports root/ big
OK: 4804 / Failed: 1 / User-skipped: 118 / Auto-skipped: 5

bosh_SUITE:essential:accept_higher_hold_value
{error,
  {{assertEqual,
     [{module,bosh_SUITE},
      {line,261},
      {expression,"get_bosh_sessions ( )"},
      {expected,[]},
      {value,
        [{bosh_session,<<"33ee84644b937f148bf4b11b2605fd9d3d5e0614">>,
           <10240.10384.0>}]}]},
   [{bosh_SUITE,accept_higher_hold_value,1,
      [{file,"/home/circleci/project/big_tests/tests/bosh_SUITE.erl"},
       {line,261}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log


mssql_mnesia_26 / odbc_mssql_mnesia / 6cedfb1
Reports root/ big
OK: 4807 / Failed: 0 / User-skipped: 121 / Auto-skipped: 0


ldap_mnesia_25 / ldap_mnesia / 6cedfb1
Reports root/ big
OK: 2275 / Failed: 0 / User-skipped: 856 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 6cedfb1
Reports root/ big
OK: 4810 / Failed: 0 / User-skipped: 118 / Auto-skipped: 0

@chrzaszcz chrzaszcz marked this pull request as ready for review February 22, 2024 09:53
Copy link
Contributor

@JanuszJakubiec JanuszJakubiec left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@JanuszJakubiec JanuszJakubiec merged commit 257a371 into feature/instrument Feb 22, 2024
4 checks passed
@JanuszJakubiec JanuszJakubiec deleted the instrument/unit-test branch February 22, 2024 11:11
@jacekwegr jacekwegr added this to the 6.3.0 milestone Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants