-
Notifications
You must be signed in to change notification settings - Fork 69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rework CI/CD #2037
Comments
The first issue that need to be addressed is the self hosted runner - it is the main bottle neck since the jobs run sequentially and often requires manual maintenance. The alternative which is currently being studied is switching to kubernetis cluster that is supported by github actions. |
CI platform has became a major limiting factor for a robust development, as was evident during 1.2 release.
As the amount of supported configurations grow, having the full CI test completing in 20+ hrs is unacceptable.
The primary weak point is the current implementation of a self-hosted runner which is a single EC2 instance, managed manually. This approach is obviously not scalable.
Instead, we should consider using docker-based approach with AWS fargate service.
In addition, we should consider doing so not only for the tests running on self hosted, but for all the tests since it will potentially be more scalable (bypassing github concurrency limitations).
Additional improvements to consider
redis-rs CI is taking too much time to finish — need to be shortening and improved:
cargo nextest
Glide enhancement
services
field of a job.Also to consider #2544
The text was updated successfully, but these errors were encountered: