Skip to content

(FM-7780) - Acceptance Test Audit #997

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 107 commits into from
Feb 14, 2019
Merged

(FM-7780) - Acceptance Test Audit #997

merged 107 commits into from
Feb 14, 2019

Conversation

pmcmaw
Copy link
Contributor

@pmcmaw pmcmaw commented Feb 13, 2019

Carrying out a test audit it appears that most functions are tested at both the acceptance and unit test level. With these being functions all we need to care about is the inputs and output. All this can be tested in unit tests. Acceptance tests have been removed where applicable and we have ensured that all use cases are being covered in the unit tests.

Note: Any acceptance tests that have been removed, we have ensured they are being tested at unit level therefore code coverage is not reduced.

This effort has been carried out by both myself and @eimlav.

These results are for a full run of our Jenkins pipeline including smoke tests and agent only testing for 2018.1 and 2019.0.

Test Step Test Time Before Audit Test Time After Audit
Smoke Tests 23mins 3mins 55secs
2018.1 Tests 35mins 10mins
2019.0 Tests 37mins 10mins

@pmcmaw pmcmaw changed the title WIP - Acceptance Test Audit (FM-7780) - Acceptance Test Audit Feb 14, 2019
@tphoney tphoney merged commit 4661089 into puppetlabs:master Feb 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants