Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revamp End-to-End testing #1729

Open
1 of 3 tasks
kyujin-cho opened this issue Nov 22, 2023 · 1 comment · Fixed by #1778 or #1918
Open
1 of 3 tasks

Revamp End-to-End testing #1729

kyujin-cho opened this issue Nov 22, 2023 · 1 comment · Fixed by #1778 or #1918
Assignees
Milestone

Comments

@kyujin-cho
Copy link
Member

kyujin-cho commented Nov 22, 2023

Main idea

Since Backend.AI project is getting complicated even more these days, it is almost impossible for us to test core functionalities only with our hands. Therefore I think this is the right time to revamp our old fashioned integration test package and introduce a daily E2E testing CI pipeline.

  • Update (or rewrite) ai.backend.test.cli_integration package so that it can be ran and report errors
  • Add new test cases for other uncovered CLI features
  • Create a Github action pipeline to execute the integration on a daily basis

Alternative ideas

No response

Anything else?

No response

@kyujin-cho kyujin-cho added the type:feature Add new features label Nov 22, 2023
@kyujin-cho kyujin-cho added this to the 24.03 milestone Nov 22, 2023
@rapsealk
Copy link
Member

rapsealk commented Nov 22, 2023

@mirageoasis You may start a new PR from #1659 if you don't mind.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment