Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Overhaul the Jenkin's test pipeline #341

Open
FinnWilkinson opened this issue Nov 2, 2023 · 1 comment
Open

Overhaul the Jenkin's test pipeline #341

FinnWilkinson opened this issue Nov 2, 2023 · 1 comment
Assignees
@ABenC377
Labels
enhancement New feature or request tests Testing and CI
Milestone
Test Suite & Repo...

Comments

@FinnWilkinson
Copy link
Contributor

Additional to the current regression testing and performance testing that the Jenkin's pipeline does, it needs to be updated to a) test more benchmakrs, b) ensure said benchmarks are functionally correct, and c) ensure that the pass/fail criteria of performance tests are robust and consistent.

We have also seen unexpected errors and behaviour when running SimEng on different Linux distributions / Operating systems. Hence, the testing that a new PR undergoes should include running tests on multiple operating systems - perhaps via docker instances
@FinnWilkinson FinnWilkinson self-assigned this Nov 2, 2023
@FinnWilkinson FinnWilkinson added enhancement New feature or request tests Testing and CI labels Nov 2, 2023
@FinnWilkinson
Copy link
Contributor Author

This should address issue #36

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ABenC377 ABenC377

Labels
enhancement New feature or request tests Testing and CI
Projects
SimEng Development
Status: In Development
Milestone
Test Suite & Repo Status Checks Update
Development

No branches or pull requests
2 participants
@FinnWilkinson @ABenC377