Skip to content

Test report reworked (#522) #523

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 18, 2022
Merged

Test report reworked (#522) #523

merged 1 commit into from
Jul 18, 2022

Conversation

nikitavlaev
Copy link
Member

@nikitavlaev nikitavlaev commented Jul 13, 2022

Description

Removed tsv.
Sarif and detailed statistics appears only in event log.
Bubble with warnings is now of warning type.

Fixes #522

Type of Change

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Manual Scenario

  1. Generate tests for anything without warnings -- works like discussed, short report in bubble, full report in event log.
  2. Generate tests for anything with warnings(mocks without mockito) -- bubble should be like a warning.

Checklist (remove irrelevant options):

  • The change followed the style guidelines of the UTBot project
  • Self-review of the code is passed
  • The change contains enough commentaries, particularly in hard-to-understand areas
  • New documentation is provided or existed one is altered
  • No new warnings
  • Tests that prove my change is effective
  • All tests pass locally with my changes

Removed tsv.
Sarif and detailed statistics appears only in event log.
Bubble with warnings is now of warning type.
@nikitavlaev nikitavlaev force-pushed the nikitavlaev/test-report branch from cac84c1 to ed98f7f Compare July 13, 2022 21:18
@Vassiliy-Kudryashov
Copy link
Member

Screenshot 2022-07-17 at 13 22 47

The message doesn't looks well (screenshot from macOS), probably for warning case we need shorter message. Full test was:

Screenshot 2022-07-17 at 13 35 15

The message for successful case also has ellipsis (...) that makes message less readable:

Screenshot 2022-07-17 at 13 37 34

Copy link
Member

@Vassiliy-Kudryashov Vassiliy-Kudryashov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have to dogfood it

@nikitavlaev nikitavlaev merged commit 0a4ac22 into main Jul 18, 2022
@nikitavlaev nikitavlaev deleted the nikitavlaev/test-report branch July 18, 2022 09:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

Poor test report usability
2 participants