Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature]: Running tests with Hoppscotch CLI in order #2928

Open
1 task done
LuchoTurtle opened this issue Feb 22, 2023 · 2 comments
Open
1 task done

[feature]: Running tests with Hoppscotch CLI in order #2928

LuchoTurtle opened this issue Feb 22, 2023 · 2 comments
Labels
cli Related to Hoppscotch CLI feature New feature or request good first issue Good for newcomers

Comments

@LuchoTurtle
Copy link

LuchoTurtle commented Feb 22, 2023

Is there an existing issue for this?

  • I have searched the existing issues

Summary

Hey there, Hoppscotch team! 👋
Thanks for the amazing work put on so far!

I'm using the Hoppscotch CLI to run some tests in Github Actions (hopp test).

I've run hopp test quite a few times and the execution flow of each test seems to be absolutely random. Shouldn't the tests be running in the same order that they appear in the json file that is exported/in the GUI? This is a bit frustrating because some tests require the correct execution of others and having no control of the execution order is a bit underwhelming.

For example, I have three folders with several requests in each one:

image

The tests are executed in the order of Tags -> Timers -> Items.
Inside each folder, the tests are run sequentially.

Is this behaviour intentional?

Why should this be worked on?

I believe the simplest solution would be running the tests in the same order they are displayed in the GUI/exported to the json file.

I think this is important for people who want to use this CLI to make API definition tests.

@LuchoTurtle LuchoTurtle added the feature New feature or request label Feb 22, 2023
@liyasthomas liyasthomas added the cli Related to Hoppscotch CLI label Aug 27, 2023
@cpanten
Copy link

cpanten commented Aug 30, 2023

The issue is related to the collectionstack in hoppscotch-cli/src/utils/collections.ts.
A stack is a last-in first-out collection. So, the last pushed folder is used as next step to do.
image

I am not a ts developer. Would be nice if an ts expert could take a look on that.
Many thanks in advanced.

@supriyahegde
Copy link

supriyahegde commented Jun 12, 2024

Hi Team,
@AndrewBastin @liyasthomas

We are also facing this issue with CLI that it doesnt run the tests in the order it is saved in the collection file.
Could you please fix this issue.

Thanks,
Supriya

@jamesgeorge007 jamesgeorge007 added the fosshack Relegated issue for FOSS Hack 2024 Partner Projects Programme label Jun 18, 2024
@SanskritiHarmukh SanskritiHarmukh added testmu The issue or PR is related to the Hoppscotch Code Quest Challenge under TestMu Conference. and removed fosshack Relegated issue for FOSS Hack 2024 Partner Projects Programme labels Aug 16, 2024
@SanskritiHarmukh SanskritiHarmukh added good first issue Good for newcomers and removed testmu The issue or PR is related to the Hoppscotch Code Quest Challenge under TestMu Conference. labels Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cli Related to Hoppscotch CLI feature New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

6 participants