Skip to content

Concrete execution fails during symbolic test generation for ListAlgorithms #1886

Open
@tyuldashev

Description

@tyuldashev

Description
Test generation for org.utbot.examples.collections.ListAlgorithms causes errors in concrete execution.

To Reproduce

Steps to reproduce the behavior:

For some reason it's reproducible only outside from UTBot project

  1. Create new project
  2. Copy org.utbot.examples.collections.ListAlgorithms and utbot-api/src/main/java/org/utbot/api from UTBot Java Project to the new project
  3. Set Symbolic execution to 100%
  4. Invoke test generation for ListAlgorithms with default settings

Expected behavior

Tests are supposed to be generated.

Actual behavior

Empty test generates with comments about concrete execution errors. For some reason there is nothing in utbot logs.

Visual proofs (screenshots, logs, images)

Example of generated class

public final class ListAlgorithmsTest {
    ///region Test suites for executable org.collections.ListAlgorithms.mergeListsInplace

    ///region Errors report for mergeListsInplace

    public void testMergeListsInplace_errors() {
        // Couldn't generate some tests. List of errors:
        // 
        // 8 occurrences of:
        // Default concrete execution failed

    }
    ///endregion

    ///endregion
}

Additional context

Reproducible with and without mocking, with 1.8 and 17 JDK. In UTBot Java project it just fails with error dialog that no tests are generated, suggesting to increase timeout.

UTbot 2022.12: In standalone project it also quickly fails (~20 sec even though timeout is 60 sec) with dialog that tests cannot be generated. So it is difficult to say if the problem is new or pre-existing.

Metadata

Metadata

Labels

comp-codegenIssue is related to code generatorcomp-symbolic-engineIssue is related to the symbolic execution enginectg-bugIssue is a buglang-javaIssue is related to Java supportpriority-top-focusTop priority chosen by dev team

Type

No type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions