Manual testing of Release 2022.10.1

[alisevych]

Initial set-up

Check that the IntelliJ Idea UTBot plugin can be successfully installed

• Build from the unit-test-bot/rc10102022 branch
• Download plugin
• Check downloaded zip-file size < 100 MB
• Open IntelliJ IDEA 2022.2.2
• Remove previously installed UTBot plugin
• Clone or reuse UTBot project (https://github.com/UnitTestBot/UTBotJava.git)
• Open the project in the IDE
• Install the downloaded plugin

Go through manual scenarios

Manual scenario #1

• Use default plugin settings
• Open the utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java file
• Generate tests for the class
• Remove results
• Generate and Run test for a method

Manual scenario #2

• Use default plugin settings
• Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file
• Generate tests with different Mocking options combinations

Manual scenario #3

• Create a new Gradle project with JDK 17
• Add a simple java file to test
• Generate a test in the existing test root

Manual scenario #4

• Create a new Maven project with JDK 8
• Add a simple java file to test
• Generate a test with a new test root

Manual scenario #5

• Create a new Idea project with JDK 11
• Add a simple java file to test
• Generate tests for several classes

Regression testing

• IDEA 2022.1.4 (JRE 11)
• IDEA 2022.2.2 (JRE 17)
• Sandbox
• Nested calls
• Recursion
• Cycles
• Mocks
• UtUtils class generation
• Summaries: tags, plain text
• Summaries: regions
• Exceptions: thrown, caught, check regions

[alisevych]

reproducing #1028
reproducing #286
reproducing #747

[alisevych]

new bug with Sandboxing and Fuzzing - many tests with same coverage are generated and no minimized
#1129

[alisevych]

new bug with Recursion - empty test class and
java.lang.Exception
at com.jetbrains.rd.util.LoggerKt.defaultLogFormat(Logger.kt:80)
at org.utbot.rd.loggers.UtRdConsoleLogger.log(UtRdConsoleLogger.kt:24)
at com.jetbrains.rd.util.SwitchLogger.log(Logger.kt:47)
at org.utbot.instrumentation.instrumentation.et.RuntimeTraceStorage.visit(TraceHandler.kt:162)
at org.utbot.examples.recursion.Recursion.fib(Recursion.java:21)
at org.utbot.examples.recursion.Recursion.fib(Recursion.java:22)
at org.utbot.examples.recursion.Recursion.fib(Recursion.java:22)
...
at org.utbot.instrumentation.instrumentation.InvokeInstrumentation$invoke$2$result$1.invoke-IoAF18A(InvokeInstrumentation.kt:60)
#1130 : reproduced once with Recursion, not reproducing with Cycles

[alisevych]

Reopened #273 - please see the comment with stack trace

[alisevych]

reproducing #711 - static field and static method

[alisevych]

new bug : sandboxed test is not compiling because commented stack trace contains "illegal unicode escape" in "jkmqh\uhauh"
#1134

[alisevych]

reproducing #1135