Skip to content

BootstrappedOnlyCompilationTests test report not printed #6211

Closed
@nicolasstucki

Description

@nicolasstucki

When executing dotty-bootsrapped/testCompilation the test report of BootstrappedOnlyCompilationTests is not printed.

This can be reproduced on https://github.com/dotty-staging/dotty/tree/boostrapped-test-no-report with dotty-bootsrapped/testCompilation failing-test

[info] Test run started
[info] Test dotty.tools.dotc.CompilationTests.negAll started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.CompilationTests.runAll started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.CompilationTests.pickling started
-- [E006] Unbound Identifier Error: /Users/nicolasstucki/GitHub/dotty/tests/pos/failing-test.scala:2:2 -----------------
2 |  dsfdsjfalksjf
  |  ^^^^^^^^^^^^^
  |  Not found: dsfdsjfalksjf
[=======================================] completed (1/1, 1 failed, 1s)
[error] Test dotty.tools.dotc.CompilationTests.pickling failed: java.lang.AssertionError: Expected no errors when compiling, failed for the following reason(s):
[error] 
[error]   - encountered 1 test failures(s), took 1.678 sec
[error]     at dotty.tools.vulpix.ParallelTesting$CompilationTest.checkCompile(ParallelTesting.scala:1040)
[error]     at dotty.tools.dotc.CompilationTests.pickling(CompilationTests.scala:206)
[error]     ...
[info] Test dotty.tools.dotc.CompilationTests.pos started
-- [E006] Unbound Identifier Error: /Users/nicolasstucki/GitHub/dotty/tests/pos/failing-test.scala:2:2 -----------------
2 |  dsfdsjfalksjf
  |  ^^^^^^^^^^^^^
  |  Not found: dsfdsjfalksjf
[=======================================] completed (1/1, 1 failed, 0s)
[error] Test dotty.tools.dotc.CompilationTests.pos failed: java.lang.AssertionError: Expected no errors when compiling, failed for the following reason(s):
[error] 
[error]   - encountered 1 test failures(s), took 0.419 sec
[error]     at dotty.tools.vulpix.ParallelTesting$CompilationTest.checkCompile(ParallelTesting.scala:1040)
[error]     at dotty.tools.dotc.CompilationTests.pos(CompilationTests.scala:100)
[error]     ...
[info] Test dotty.tools.dotc.CompilationTests.tastyBootstrap started
No files matched "failing-test" in test                                         
No files matched "failing-test" in test                                         
No files matched "failing-test" in test                                         
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.CompilationTests.posTwice started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.CompilationTests.fuzzyAll started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.CompilationTests.genericJavaSignatures started
No files matched "failing-test" in test                                         

================================================================================
Test Report
================================================================================

0 suites passed, 2 failed, 2 total
    tests/pos/failing-test.scala failed
    tests/pos/failing-test.scala failed


--------------------------------------------------------------------------------
Note - reproduction instructions have been dumped to log file:
    /Users/nicolasstucki/GitHub/dotty/testlogs/tests-2019-04-02/tests-2019-04-02-T16-29-26.log
--------------------------------------------------------------------------------
[info] Test run finished: 2 failed, 0 ignored, 8 total, 3.239s
[info] Test run started
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.negAll started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.testPlugins started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.posWithCompiler started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.posTwiceWithCompiler started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.picklingWithCompiler started
No files matched "failing-test" in test                                         
[info] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.runWithCompiler started
-- [E006] Unbound Identifier Error: /Users/nicolasstucki/GitHub/dotty/tests/run-with-compiler/failing-test.scala:2:2 ---
2 |  dsfdsjfalksjf
  |  ^^^^^^^^^^^^^
  |  Not found: dsfdsjfalksjf
    Compilation failed for: 'tests/run-with-compiler/failing-test.scala'                               
[=======================================] completed (1/1, 2 failed, 0s)
[error] Test dotty.tools.dotc.BootstrappedOnlyCompilationTests.runWithCompiler failed: java.lang.AssertionError: Run test failed, but should not, reasons:
[error] 
[error]   - encountered 2 test failures(s), took 0.159 sec
[error]     at dotty.tools.vulpix.ParallelTesting$CompilationTest.checkRuns(ParallelTesting.scala:1092)
[error]     at dotty.tools.dotc.BootstrappedOnlyCompilationTests.runWithCompiler(BootstrappedOnlyCompilationTests.scala:84)
[error]     ...
[info] Test run finished: 1 failed, 0 ignored, 6 total, 0.618s
[error] Failed: Total 14, Failed 3, Errors 0, Passed 11
[error] Failed tests:
[error] 	dotty.tools.dotc.BootstrappedOnlyCompilationTests
[error] 	dotty.tools.dotc.CompilationTests
[error] (dotty-compiler-bootstrapped / Test / testOnly) sbt.TestsFailedException: Tests unsuccessful

Note that the Test Report

================================================================================
Test Report
================================================================================

is only printed for the CompilationTests.

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions