Skip to content

Commit 725ff40

Browse files
authored
Fail run conformance test make target on test failure (#1177)
1 parent 29b45e3 commit 725ff40

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

conformance/Makefile

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,9 @@ run-conformance-tests: ## Run conformance tests
7979
--report-output=output.txt; cat output.txt" | tee output.txt
8080
sed -e '1,/CONFORMANCE PROFILE/d' output.txt > conformance-profile.yaml
8181
rm output.txt
82+
$(eval result_core=$(shell cat conformance-profile.yaml | yq '.profiles[0].core.result'))
83+
$(eval result_extended=$(shell cat conformance-profile.yaml | yq '.profiles[0].extended.result'))
84+
[ "$(result_core)" != "failure" ] && [ "$(result_extended)" != "failure" ] || exit 2
8285

8386
.PHONY: cleanup-conformance-tests
8487
cleanup-conformance-tests: ## Clean up conformance tests fixtures

0 commit comments

Comments
 (0)