E2E: Investigate Running a whole test suite per host

[chatton]

Summary

Investigate running a whole test suite on a single GH runner to check performance vs running a single test per host.

ref #3329

---

For Admin Use

• Not duplicate issue
• Appropriate labels applied
• Appropriate contributors tagged/assigned

[chatton]

I think a situation in which we run each over a separate channel, but all one one host could reduce runner usage drastically. As long as we are still able to run individual tests locally this could be a win-win