Skip to content

Add the detected exceptions metric to Contest Estimator #1749

Closed
@mmvpm

Description

@mmvpm

Description

Contest Estimator is used to track utbot changes in coverage concepts, that is, how many lines of code generated tests can cover.

Now we want to track another metric – the number of detected exceptions.

Expected behavior

We will be able to specify expected unchecked exceptions for the project under test in a file called "exceptions" in the following format:

<class fully qualified name>.<method name>: <expected exception fqn> <another expected exception fqn> ...

For example:

org.utbot.examples.codeforces.exception.siobe.Task_1702B.solve: java.lang.StringIndexOutOfBoundsException

So now we expect that utbot will detect an exception in the Task_1702B.solve method.

Metadata

Metadata

Assignees

Labels

comp-contest-estimatorIssue is related to contest estimatorctg-enhancementNew feature, improvement or change request

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions