Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Implement Matrix testing in CI #544

Open
jharley opened this issue Sep 13, 2024 · 0 comments
Open

Implement Matrix testing in CI #544

jharley opened this issue Sep 13, 2024 · 0 comments
Labels
improvement refactor Internal improvements.
Milestone

Comments

@jharley
Copy link
Collaborator

jharley commented Sep 13, 2024

We currently run all integration tests with Terraform 1.0.11 (configured here) and haven't yet completed the work to enable parallel runs of the integration test suite against the same Honeycomb Team/Environment.

Ahead of cutting 1.0, testing with multiple X.Y.* versions of Terraform (and possibly OpenTofu) will allow us to ensure we're building features that work for the commonly used versions of Terraform (e.g. 1.[0-9].*).

This work is likely done in a few steps:

  1. remove the need for the 'setup helper' bash script so that both the client and the provider integration tests pass
  2. refactor the 'shape' of the CI work flow to look something like this:
    • lint+build
    • fanout to parallel US and EU tracks
      • run client tests for both regions in parallel
      • run integration tests for both regions in parallel
  3. add a test matrix to the integration tests

HashiCorp has provided an example of a matrix pipeline for acceptance tests here.

@jharley jharley added refactor Internal improvements. improvement labels Sep 13, 2024
@jharley jharley added this to the 1.0.0 milestone Sep 13, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
improvement refactor Internal improvements.
Projects
None yet
Development

No branches or pull requests

1 participant