Run a single suite with N instances in parallel with different `BeforeSuite` Setup. about ginkgo HOT 3 CLOSED

@onsi can you PTAL at this once. Thanks :)

from ginkgo.

heyo - sorry for the delay. I've been out of pocket for a couple of weeks.

Ginkgo doesn't directly support this usecase. I can imagine some workarounds but nothing that will be super clean. I would, personally, approach this by making the cloud provider configurable (e.g. via a command line argument or an environment variable) and then invoke ginkgo multiple times for each cloud provider (e.g. in series). This gives you a building block that you can then leverage in CI. For example, back in the day the Cloud Foundry test suite could run against a variety of cloud providers. A single Ginkgo suite could target any of these given different configuration inputs. We would run them in parallel in CI - using the CI system's built in capacity for parallel builds to nicely sequester and monitor the different ginkgo suites.

This is, honestly, a bit cleaner as you end up with logs and reports that are cleanly sequestered by cloud provider. It also makes it a bit easier to write cloud-provider-specific specs.

Could something like this be added to Ginkgo? No doubt. But it's not something that's currently on the roadmap. I'd suggest going down the CI route.

from ginkgo.

Thanks @onsi for taking the time to comment. Yes it does seem like more approachable and cleaner way to run them in parallel in CI. Thanks for the advice :)

from ginkgo.