Skip to content

Smoke testing of UTBot Java main flow #2356

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
33 tasks done
alisevych opened this issue Jul 3, 2023 · 1 comment
Closed
33 tasks done

Smoke testing of UTBot Java main flow #2356

alisevych opened this issue Jul 3, 2023 · 1 comment
Assignees
Labels
ctg-qa Issue is related to QA process

Comments

@alisevych
Copy link
Member

alisevych commented Jul 3, 2023

Initial set-up

Check that the IntelliJ Idea UTBot plugin can be successfully installed

Go through manual scenarios

Manual scenario #1

  • Use default plugin settings
  • Open the utbot-sample/src/main/java/org/utbot/examples/algorithms/ArraysQuickSort.java file
  • Generate tests for the class
  • Remove results
  • Generate and Run test for a method
  • Check only expected tests are red (failing on exceptions)
  • Check there are no yellow tests (failing on asserts)

Manual scenario #2

  • Use default plugin settings
  • Open the utbot-sample/src/main/java/org/utbot/examples/mock/CommonMocksExample.java file
  • Generate and Run tests with different Mocking options
  • Check only expected tests are red (failing on exceptions)
  • Check there are no yellow tests (failing on asserts)
  • Check generated tests consistency, layout, naming, correct mocking

Manual scenario #3

  • Create a new Gradle project with JDK 17
  • Add a sample java file to test
  • Generate a test in the existing test root
  • Check generated tests consistency, layout, naming

Manual scenario #4

  • Create a new Maven project with JDK 8
  • Add a sample java file to test
  • Generate a test with a new test root
  • Check generated tests consistency, layout, naming

Manual scenario #5

  • Create a new IntelliJ project with JDK 11
  • Add a sample java file to test
  • Generate tests for several classes
  • Check generated tests consistency, layout, naming
@alisevych alisevych added the ctg-qa Issue is related to QA process label Jul 3, 2023
@alisevych alisevych added this to the Spring July stabilization milestone Jul 3, 2023
@alisevych alisevych changed the title Regression testing of UTBot Java main flow Smoke testing of UTBot Java main flow Jul 4, 2023
@alisevych alisevych changed the title Smoke testing of UTBot Java main flow Regression testing of UTBot Java main flow Jul 4, 2023
@alisevych alisevych moved this from Todo to In Progress in UTBot Java Jul 6, 2023
@tyuldashev
Copy link
Collaborator

One pre-existing issue has been opened - #2376.
Also need to note that plugin size is much bigger than 100Mb now - around 180Mb

@github-project-automation github-project-automation bot moved this from In Progress to Done in UTBot Java Jul 7, 2023
@alisevych alisevych changed the title Regression testing of UTBot Java main flow Smoke testing of UTBot Java main flow Jul 7, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
ctg-qa Issue is related to QA process
Projects
Archived in project
Development

No branches or pull requests

2 participants