Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: cmsis_dsp: rf16 and cf16 tests are not executed on Native POSIX #43816

Closed
gopiotr opened this issue Mar 15, 2022 · 1 comment · Fixed by #43822
Closed

tests: cmsis_dsp: rf16 and cf16 tests are not executed on Native POSIX #43816

gopiotr opened this issue Mar 15, 2022 · 1 comment · Fixed by #43822
Assignees
Labels
area: CMSIS-DSP area: Tests Issues related to a particular existing or missing test bug The issue is a bug, or the PR is fixing a bug priority: low Low impact/importance bug

Comments

@gopiotr
Copy link
Collaborator

gopiotr commented Mar 15, 2022

Describe the bug
Following test scenarios:

  • libraries.cmsis_dsp.transform.cf16
  • libraries.cmsis_dsp.transform.cf16.fpu
  • libraries.cmsis_dsp.transform.rf16
  • libraries.cmsis_dsp.transform.rf16.fpu

From this directory:
tests/lib/cmsis_dsp/transform/
are not executed - only PROJECT EXECUTION SUCCESSFUL is printed.
Problem concerns only native_posix platform.
On mps2_an521 and mps2_an521_remote platforms everything works properly.

To Reproduce
Steps to reproduce the behavior:

  1. Run Twister by this command:
    ./scripts/twister -p native_posix -T tests/lib/cmsis_dsp/transform/
  2. Analyze twister.log file - especially execution of rf16 and cf16 tests.

Expected behavior
Tests should be executed - not only printing of PROJECT EXECUTION SUCCESSFUL information.

Impact
At this moment those tests are marked as PASS what is misleading information, because they aren't even executed.

Logs and console output

2022-03-15 17:14:39,977 - twister - DEBUG - Spawning BinaryHandler Thread for native_posix/tests/lib/cmsis_dsp/transform/libraries.cmsis_dsp.transform.cf16.fpu
2022-03-15 17:14:39,978 - twister - DEBUG - OUTPUT: *** Booting Zephyr OS build zephyr-v3.0.0-884-gadc901aa6a39  ***
2022-03-15 17:14:39,978 - twister - DEBUG - OUTPUT: ===================================================================
2022-03-15 17:14:39,979 - twister - DEBUG - OUTPUT: PROJECT EXECUTION SUCCESSFUL
2022-03-15 17:14:39,979 - twister - DEBUG - OUTPUT: 

Environment (please complete the following information):

  • OS: Linux
  • Toolchain: Zephyr SDK
  • Commit SHA: adc901a

Additional context
Similar problem occurred here:
#42396
But I verified, that those tests do not work since the beginning - since they was added in those commits:
600ca01
6547025
So, the source of problem is probably not connected with changes introduced in ZTest API in October last year.

This problem was discovered during review of this PR:
#42482
Enhancement proposed in this PR could help to avoid this situation, due to the additional verification of printed test suite name.

If everything works properly on QEMU platforms, then perhaps it should be considered to remove support for Native POSIX platform for those tests?

@gopiotr gopiotr added the bug The issue is a bug, or the PR is fixing a bug label Mar 15, 2022
@stephanosio stephanosio added area: Tests Issues related to a particular existing or missing test area: CMSIS-DSP labels Mar 15, 2022
@gopiotr gopiotr changed the title tests: cmsis_dsp: rf16 and cf16 tests are not executed tests: cmsis_dsp: rf16 and cf16 tests are not executed on Native POSIX Mar 15, 2022
@stephanosio stephanosio added the priority: low Low impact/importance bug label Mar 15, 2022
@stephanosio
Copy link
Member

NOTE: similar situation with the matrix tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: CMSIS-DSP area: Tests Issues related to a particular existing or missing test bug The issue is a bug, or the PR is fixing a bug priority: low Low impact/importance bug
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants