Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add instrumentation for other auth events #4311

Merged
merged 4 commits into from
Jul 1, 2024

Conversation

arcusfelis
Copy link
Contributor

This PR addresses #

Proposed changes include:

  • describe the functionality changes
  • describe new or updated tests
  • describe changes to the documentation

@mongoose-im
Copy link
Collaborator

mongoose-im commented Jun 24, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / e156e3f
Reports root/ big
OK: 457 / Failed: 0 / User-skipped: 41 / Auto-skipped: 0


small_tests_25 / small_tests / e156e3f
Reports root / small


small_tests_26 / small_tests / e156e3f
Reports root / small


small_tests_26_arm64 / small_tests / e156e3f
Reports root / small


ldap_mnesia_25 / ldap_mnesia / e156e3f
Reports root/ big
OK: 2287 / Failed: 2 / User-skipped: 906 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_267@localhost/escalus-default-resource">>,
         escalus_tcp,<0.5171.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_267">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"ec57140ae30ffa03">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1291}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1223}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1350}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log


ldap_mnesia_26 / ldap_mnesia / e156e3f
Reports root/ big
OK: 2287 / Failed: 2 / User-skipped: 906 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_282@localhost/escalus-default-resource">>,
         escalus_tcp,<0.5184.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_282">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"766332c8a95f6fcc">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / e156e3f
Reports root/ big
OK: 4598 / Failed: 22 / User-skipped: 106 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"[email protected]/escalus-default-resource">>,
         escalus_tcp,<0.6670.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_397">>},
          {server,<<"domain.example.com">>},
          {host,<<"localhost">>},
          {password,<<"matygrysa">>},
          {stream_id,<<"f5b4db0b04439f8f">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1291}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1223}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1350}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,512}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,512}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log


dynamic_domains_mysql_redis_26 / mysql_redis / e156e3f
Reports root/ big
OK: 4565 / Failed: 22 / User-skipped: 139 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"[email protected]/escalus-default-resource">>,
         escalus_tcp,<0.6664.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_375">>},
          {server,<<"domain.example.com">>},
          {host,<<"localhost">>},
          {password,<<"matygrysa">>},
          {stream_id,<<"ab7a9e48fa97e60e">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / e156e3f
Reports root/ big
OK: 4598 / Failed: 22 / User-skipped: 106 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"[email protected]/escalus-default-resource">>,
         escalus_tcp,<0.6671.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_374">>},
          {server,<<"domain.example.com">>},
          {host,<<"localhost">>},
          {password,<<"matygrysa">>},
          {stream_id,<<"ee0d81a62e404ae7">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


internal_mnesia_26 / internal_mnesia / e156e3f
Reports root/ big
OK: 2427 / Failed: 2 / User-skipped: 766 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_272@localhost/escalus-default-resource">>,
         escalus_tcp,<0.5223.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_272">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"56bf699ea5ee46ab">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


pgsql_cets_26 / pgsql_cets / e156e3f
Reports root/ big
OK: 4517 / Failed: 2 / User-skipped: 174 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_388@localhost/escalus-default-resource">>,
         escalus_tcp,<0.6733.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_388">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"2a042a76905bcf0c">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / e156e3f
Reports root/ big
OK: 4594 / Failed: 23 / User-skipped: 109 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"[email protected]/escalus-default-resource">>,
         escalus_tcp,<0.6674.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_383">>},
          {server,<<"domain.example.com">>},
          {host,<<"localhost">>},
          {password,<<"matygrysa">>},
          {stream_id,<<"fd60273111388ae2">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

connect_SUITE:just_tls:starttls_required:starttls_required_parallel:cannot_connect_with_proxy_header
{error,
  {thrown,
    {{timeout,stream_end},
     [{escalus_connection,get_stream_end,2,
        [{file,
           "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"},
         {line,369}]},
      {escalus_connection,end_stream,1,
        [{file,
           "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"},
         {line,507}]},
      {escalus_connection,stop,1,
        [{file,
           "/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_connection.erl"},
         {line,407}]},
      {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
      {test_server,run_test_case_eval1,6,
        [{file,"test_server.erl"},{line,1302}]},
      {test_server,run_test_case_eval,9,
        [{file,"test_server.erl"},{line,1234}]}]}}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


mysql_redis_26 / mysql_redis / e156e3f
Reports root/ big
OK: 4989 / Failed: 2 / User-skipped: 134 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_379@localhost/escalus-default-resource">>,
         escalus_tcp,<0.6725.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_379">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"c1bfacd86e78f6bc">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


pgsql_mnesia_25 / pgsql_mnesia / e156e3f
Reports root/ big
OK: 5010 / Failed: 2 / User-skipped: 113 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_388@localhost/escalus-default-resource">>,
         escalus_tcp,<0.6720.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_388">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"7c09a2d231ed8219">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1291}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1223}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1350}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log


pgsql_mnesia_26 / pgsql_mnesia / e156e3f
Reports root/ big
OK: 5010 / Failed: 2 / User-skipped: 113 / Auto-skipped: 0

auth_methods_for_c2s_SUITE:two_methods_enabled:cannot_login_with_not_allowed_method
{error,
  {{badmatch,
     {ok,{client,
         <<"alice_unnamed_377@localhost/escalus-default-resource">>,
         escalus_tcp,<0.6720.0>,undefined,
         [{password,<<"wrong">>},
          {username,<<"alice_unnamed_377">>},
          {server,<<"localhost">>},
          {password,<<"matygrysa">>},
          {host,<<"localhost">>},
          {stream_id,<<"4b3f5d27b21b57b3">>},
          {resource,<<"escalus-default-resource">>}]},
       [{compression,false},
        {starttls,true},
        {stream_management,true},
        {advanced_message_processing,true},
        {client_state_indication,false},
        {sasl_mechanisms,[<<"SCRAM-SHA-256">>,<<"PLAIN">>]},
        {caps,undefined}]}},
   [{auth_methods_for_c2s_SUITE,cannot_login_with_not_allowed_method,1,
      [{file,
         "/home/circleci/project/big_tests/tests/auth_methods_for_c2s_SUITE.erl"},
       {line,89}]},
    {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
    {test_server,run_test_case_eval1,6,
      [{file,"test_server.erl"},{line,1302}]},
    {test_server,run_test_case_eval,9,
      [{file,"test_server.erl"},{line,1234}]}]}}

Report log

auth_methods_for_c2s_SUITE:metrics:metrics_incremented_on_user_connect
{error,{{badmatch,[]},
    [{escalus_mongooseim,metric_type,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,100}]},
     {escalus_mongooseim,read_metric_initial_value,2,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,60}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1594}]},
     {escalus_mongooseim,maybe_read_initial_metric_values,1,
               [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_mongooseim.erl"},
                {line,38}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,68}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

Copy link

codecov bot commented Jun 24, 2024

Codecov Report

Attention: Patch coverage is 90.90909% with 2 lines in your changes missing coverage. Please review.

Project coverage is 84.68%. Comparing base (14280cf) to head (27a2f9f).
Report is 17 commits behind head on feature/instrument.

Files Patch % Lines
src/auth/ejabberd_auth.erl 90.90% 2 Missing ⚠️
Additional details and impacted files
@@                  Coverage Diff                   @@
##           feature/instrument    #4311      +/-   ##
======================================================
+ Coverage               84.64%   84.68%   +0.03%     
======================================================
  Files                     557      557              
  Lines                   33889    33878      -11     
======================================================
+ Hits                    28685    28689       +4     
+ Misses                   5204     5189      -15     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@arcusfelis arcusfelis marked this pull request as draft June 26, 2024 08:41
@mongoose-im
Copy link
Collaborator

mongoose-im commented Jun 26, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / b4a112a
Reports root/ big
OK: 457 / Failed: 0 / User-skipped: 41 / Auto-skipped: 0


small_tests_25 / small_tests / b4a112a
Reports root / small


small_tests_26 / small_tests / b4a112a
Reports root / small


small_tests_26_arm64 / small_tests / b4a112a
Reports root / small


ldap_mnesia_25 / ldap_mnesia / b4a112a
Reports root/ big
OK: 2289 / Failed: 0 / User-skipped: 906 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / b4a112a
Reports root/ big
OK: 4600 / Failed: 20 / User-skipped: 106 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,512}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,512}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{expected_type => ok,
      response_code => {exit_status,1},
      what => invalid_response_code},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1782}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1291}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1223}]}]}}

Report log


ldap_mnesia_26 / ldap_mnesia / b4a112a
Reports root/ big
OK: 2289 / Failed: 0 / User-skipped: 906 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / b4a112a
Reports root/ big
OK: 4567 / Failed: 20 / User-skipped: 139 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


internal_mnesia_26 / internal_mnesia / b4a112a
Reports root/ big
OK: 2429 / Failed: 0 / User-skipped: 766 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / b4a112a
Reports root/ big
OK: 4600 / Failed: 20 / User-skipped: 106 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


pgsql_cets_26 / pgsql_cets / b4a112a
Reports root/ big
OK: 4519 / Failed: 0 / User-skipped: 174 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / b4a112a
Reports root/ big
OK: 4597 / Failed: 20 / User-skipped: 109 / Auto-skipped: 0

accounts_SUITE:registration_watchers:admin_notify
{error,{test_case_failed,"No instrumentation events matched"}}

Report log

accounts_SUITE:end_per_suite
{error,{test_case_failed,"Instrumentation events that were logged, but not tested:\n[{auth_authorize,#{host_type => <<\"test type\">>}}]\nYou need to test them with instrument_helper:assert/3"}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,
  {function_clause,
    [{lists,sort,[null],[{file,"lists.erl"},{line,647}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,
  {badarg,
    [{erlang,length,[null],[{error_info,#{module => erl_erts_errors}}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
       [{file,
          "/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
        {line,421}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
       [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
       [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_http:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{{assertEqual,[{module,graphql_last_SUITE},
            {line,430},
            {expression,"get_ok_value ( p ( listOldUsers ) , Res )"},
            {expected,[]},
            {value,null}]},
    [{graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_list_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_list_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,414}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_remove_old_users_global
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_remove_old_users_global_story,4,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,370}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_user_without_last_info_is_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_user_without_last_info_is_old_user,1,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,420}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_configured:admin_old_users:admin_logged_user_is_not_old_user
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {graphql_last_SUITE,admin_logged_user_is_not_old_user_story,2,
               [{file,"/home/circleci/project/big_tests/tests/graphql_last_SUITE.erl"},
                {line,430}]},
     {escalus_story,story,4,
            [{file,"/home/circleci/project/big_tests/_build/default/lib/escalus/src/escalus_story.erl"},
             {line,72}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_remove_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_last_SUITE:admin_cli:admin_last_not_configured_group:admin_last_not_configured_old_users:admin_list_old_users_global_last_not_configured
{error,{#{what => invalid_response_code,
      response_code => {exit_status,1},
      expected_type => ok},
    [{graphql_helper,assert_response_code,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,258}]},
     {graphql_helper,get_ok_value,2,
             [{file,"/home/circleci/project/big_tests/tests/graphql_helper.erl"},
              {line,241}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_http:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

graphql_stats_SUITE:admin_stats_cli:admin_stats_global_test
{error,{{assertEqual,[{module,graphql_stats_SUITE},
            {line,81},
            {expression,"RegisteredUsers"},
            {expected,0},
            {value,1}]},
    [{graphql_stats_SUITE,admin_stats_global_test,1,
                [{file,"/home/circleci/project/big_tests/tests/graphql_stats_SUITE.erl"},
                 {line,81}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_easy_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_pool_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_async_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log

mam_SUITE:rdbms_mnesia_cache_impl_specific:check_user_exist
{error,{{badmatch,{error,exists}},
    [{mam_SUITE,check_user_exist,1,
          [{file,"/home/circleci/project/big_tests/tests/mam_SUITE.erl"},
           {line,3622}]},
     {test_server,ts_tc,3,[{file,"test_server.erl"},{line,1793}]},
     {test_server,run_test_case_eval1,6,
            [{file,"test_server.erl"},{line,1302}]},
     {test_server,run_test_case_eval,9,
            [{file,"test_server.erl"},{line,1234}]}]}}

Report log


pgsql_mnesia_25 / pgsql_mnesia / b4a112a
Reports root/ big
OK: 5012 / Failed: 0 / User-skipped: 113 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / b4a112a
Reports root/ big
OK: 4991 / Failed: 0 / User-skipped: 134 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / b4a112a
Reports root/ big
OK: 5012 / Failed: 0 / User-skipped: 113 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / b4a112a
Reports root/ big
OK: 5009 / Failed: 0 / User-skipped: 116 / Auto-skipped: 0

@mongoose-im
Copy link
Collaborator

mongoose-im commented Jun 26, 2024

elasticsearch_and_cassandra_26 / elasticsearch_and_cassandra_mnesia / 27a2f9f
Reports root/ big
OK: 457 / Failed: 0 / User-skipped: 41 / Auto-skipped: 0


small_tests_25 / small_tests / 27a2f9f
Reports root / small


small_tests_26 / small_tests / 27a2f9f
Reports root / small


small_tests_26_arm64 / small_tests / 27a2f9f
Reports root / small


ldap_mnesia_25 / ldap_mnesia / 27a2f9f
Reports root/ big
OK: 2289 / Failed: 0 / User-skipped: 906 / Auto-skipped: 0


ldap_mnesia_26 / ldap_mnesia / 27a2f9f
Reports root/ big
OK: 2289 / Failed: 0 / User-skipped: 906 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_26 / pgsql_mnesia / 27a2f9f
Reports root/ big
OK: 4620 / Failed: 0 / User-skipped: 106 / Auto-skipped: 0


dynamic_domains_pgsql_mnesia_25 / pgsql_mnesia / 27a2f9f
Reports root/ big
OK: 4620 / Failed: 0 / User-skipped: 106 / Auto-skipped: 0


dynamic_domains_mysql_redis_26 / mysql_redis / 27a2f9f
Reports root/ big
OK: 4587 / Failed: 0 / User-skipped: 139 / Auto-skipped: 0


internal_mnesia_26 / internal_mnesia / 27a2f9f
Reports root/ big
OK: 2429 / Failed: 0 / User-skipped: 766 / Auto-skipped: 0


dynamic_domains_mssql_mnesia_26 / odbc_mssql_mnesia / 27a2f9f
Reports root/ big
OK: 4617 / Failed: 0 / User-skipped: 109 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 27a2f9f
Reports root/ big
OK: 4518 / Failed: 1 / User-skipped: 174 / Auto-skipped: 0

tr_util_SUITE:c2s_elements
{error,{{badmatch,[#{name => <<"message">>,type => <<"chat">>,
           hooks => [user_send_packet],
           jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           from_jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           to_jid => <<"bob_c2s_elements_3317@localhost/res1">>,
           contents => <<"<body>Hello</body>">>,
           ref => #Ref<10243.283254913.2936012802.61007>},
           #{name => <<"message">>,type => <<"chat">>,
           hooks => [user_receive_packet,user_receive_message],
           jid => <<"bob_c2s_elements_3317@localhost/res1">>,
           from_jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           to_jid => <<"bob_c2s_elements_3317@localhost/res1">>,
           contents => <<"<body>Hello</body>">>,
           ref => #Ref<10243.283254913.2936012802.61014>},
           #{name => <<"message">>,type => <<"chat">>,
           hooks => [user_send_message],
           jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           from_jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           to_jid => <<"bob_c2s_elements_3317@localhost/res1">>,
           contents => <<"<body>Hello</body>">>,
           ref => #Ref<10243.283254913.2936012802.61007>},
           #{name => <<"message">>,type => <<"chat">>,
           hooks => [xmpp_presend_element],
           jid => <<"bob_c2s_elements_3317@localhost/res1">>,
           from_jid => <<"alice_c2s_elements_3317@localhost/res1">>,
           to_jid => <<"bob_c2s_elem...

Report log


pgsql_mnesia_25 / pgsql_mnesia / 27a2f9f
Reports root/ big
OK: 5012 / Failed: 0 / User-skipped: 113 / Auto-skipped: 0


mysql_redis_26 / mysql_redis / 27a2f9f
Reports root/ big
OK: 4991 / Failed: 0 / User-skipped: 134 / Auto-skipped: 0


pgsql_mnesia_26 / pgsql_mnesia / 27a2f9f
Reports root/ big
OK: 5012 / Failed: 0 / User-skipped: 113 / Auto-skipped: 0


mssql_mnesia_26 / odbc_mssql_mnesia / 27a2f9f
Reports root/ big
OK: 5009 / Failed: 0 / User-skipped: 116 / Auto-skipped: 0


pgsql_cets_26 / pgsql_cets / 27a2f9f
Reports root/ big
OK: 4519 / Failed: 0 / User-skipped: 174 / Auto-skipped: 0

@arcusfelis arcusfelis marked this pull request as ready for review June 27, 2024 07:01
Copy link
Contributor

@gustawlippa gustawlippa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks very good to me, although I have a small comment regarding mocking in small tests, because I had a similar issue. Maybe we could wait for input there, so we can resolve it the same way in both PRs?

It's not this PRs scope or anything, but the code in auth is a bit confusing for me, with this op => map thingy. It could at least be an op => map | filter in my opinion to indicate what is even going on there :D But it's a story for another day.


meck:expect(mongoose_domain_api, get_domain_host_type,
fun(?DOMAIN) -> {ok, ?HOST_TYPE} end),
meck:expect(mongoose_metrics, update, fun(_, _, _) -> ok end),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if it's not better to mock the mongoose_instrument module in this case? I had a very similar case in my PR, and Paweł commented: https://github.com/esl/MongooseIM/pull/4306/files#r1654832111
I guess just starting instrumentation is also an option, although if we don't test the results (matched events) anyway, then why not mock them...

Copy link
Member

@chrzaszcz chrzaszcz Jul 1, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like that it's not mocked, because it detects the case when instrumentation would crash. Anyway, just starting it is easy.

Copy link
Member

@chrzaszcz chrzaszcz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good 👍

@chrzaszcz chrzaszcz merged commit 183802d into feature/instrument Jul 1, 2024
4 checks passed
@chrzaszcz chrzaszcz deleted the instrument-auth branch July 1, 2024 08:34
@jacekwegr jacekwegr added this to the 6.3.0 milestone Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants