Skip to content

Commit c21fdd9

Browse files
tomreecetomreece
authored
Merge branch 'develop' into sample-test-run
2 parents 7634acf + ce889d8 commit c21fdd9

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

44 files changed

+1089
-223
lines changed

‎CHANGELOG.md

Lines changed: 64 additions & 96 deletions
Original file line numberDiff line numberDiff line change
@@ -1,130 +1,98 @@
11
Magento Functional Testing Framework Changelog
22
================================================
3-
3.0.0 RC5
4-
---------
5-
6-
### Enhancements
7-
8-
* Readability
9-
* Removed blacklist/whitelist terminology in MFTF.
10-
11-
### Fixes
12-
13-
* Fixed javascript error seen on chrome 81 for dragAndDrop action.
14-
* Fixed allure issue when `WebDriverCurlException` is encountered in `afterStep`.
15-
16-
3.0.0 RC4
3+
3.0.0
174
---------
185

196
### Enhancements
207

218
* Customizability
9+
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.[See custom-helpers page for details](./docs/custom-helpers.md)
10+
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
2211
* `<group value="skip"/>` no longer skips a test. Instead, the test is added to the `skip` group.
12+
2313
* Maintainability
14+
* Added support for PHP 7.4.
15+
* Added support for PHPUnit 9.
16+
* Dropped support for PHP 7.0, 7.1, 7.2.
17+
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
18+
* Support for sub-folders in test modules.
19+
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
20+
* Removed file attribute for `<module>` in suiteSchema.
21+
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
22+
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
23+
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
24+
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
25+
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
26+
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
27+
* Removed delta option from `assertEquals` and `assertNotEquals`.
28+
* Added static check `deprecatedEntityUsage` that checks and reports references to deprecated test entities.
29+
* Added static check `annotations` that checks and reports missing annotations in tests.
30+
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
31+
* Added support for Two-Factor Authentication (2FA). [See configure-2fa page for details](./docs/configure-2fa.md)
32+
* Added new upgrade script to remove unused arguments from action groups.
2433
* `mftf.log` no longer includes notices and warnings at test execution time.
34+
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
2535
* Added the Chrome option `--ignore-certificate-errors` to `functional.suite.dist.yml`.
36+
2637
* Traceability
38+
* Removed `--debug` option `NONE` to disallow ability to turn off schema validation.
39+
* Notices added for test entity naming convention violations.
40+
* Metadata file names changed to `*Meta.xml`.
41+
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
2742
* Changed the `bin/mftf static-checks` error file directory from the current working directory to `TESTS_BP/tests/_output/static-results/`.
43+
2844
* Readability
29-
* Documented [3.0.0 Backward Incompatible Changes.](./docs/backward-incompatible-changes.md)
30-
31-
### Fixes
32-
33-
* Fixed issue where an extended data entity would not merge array items. Array items should merge properly now.
34-
* Fixed issue where Chrome remains running after MFTF suite finishes.
35-
36-
3.0.0 RC3
37-
---------
45+
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md).
46+
* Documented [3.0.0 Backward Incompatible Changes](./docs/backward-incompatible-changes.md).
47+
* Removed blacklist/whitelist terminology in MFTF.
48+
49+
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
50+
* Bumped dependencies to support PHP/PHPUnit upgrade.
3851

39-
### Enhancements
52+
### Upgrade Instructions
4053

41-
* Maintainability
42-
* Added support for Two-Factor Authentication (2FA). [See configure-2fa page for details](./docs/configure-2fa.md)
43-
* Added new static check `annotationsCheck` that checks and reports missing annotations in tests.
44-
* Updated `bin/mftf static-checks` command to allow executing static-checks defined in `staticRuleSet.json` by default. [See command page for details](./docs/commands/mftf.md#static-checks)
45-
* Added new upgrade script to remove unused arguments from action groups.
46-
* Added unhandledPromptBehavior driver capability for Chrome 75+ support.
47-
* Removed redundant and unused classes.
54+
* Run `bin/mftf reset --hard` to remove old generated configurations.
55+
* Run `bin/mftf build:project` to generate new configurations.
56+
* Run `bin/mftf upgrade:tests`. [See command page for details](./docs/commands/mftf.md#upgradetests).
57+
* After running the above command, some tests may need manually updates:
58+
* Remove all occurrences of `<executeInSelenium>` and `<performOn>`.
59+
* Remove all occurrences of `<module file=""/>` from any `<suite>`s.
60+
* Ensure all `<assert*>` actions in your tests have a valid schema.
61+
* Lastly, try to generate all tests. Tests should all be generated as a result of the upgrades.
62+
* If not, the most likely issue will be a changed XML schema. Check error messaging and search your codebase for the attributes listed.
4863

4964
### Fixes
5065

66+
* Throw exception during generation when leaving out .url for `amOnPage`.
67+
* `request_timeout` and `connection_timeout` added to functional.suite.yml.dist.
68+
* Fixed `ModuleResolver` to resolve test modules moved out of deprecated path.
69+
* Fixed issue of resolving arguments of type `entity` in action groups within a custom helper.
70+
* Fixed reporting issue in output file for `testDependencies` static check.
71+
* Fixed a bug in `actionGroupArguments` static check when action group filename is missing `ActionGroup`.
72+
* Fixed issue of running suites under root `_suite` directory in Standalone MFTF.
5173
* Fixed issue with custom helper usage in suites.
5274
* Fixed issue with decryption of secrets during data entity creation.
5375
* Fixed issue with merging of `array` items in data entity.
54-
55-
3.0.0 RC2
56-
---------
57-
58-
### Enhancements
59-
60-
* Maintainability
61-
* Added support for PHP 7.4.
62-
* Removed support for PHP 7.2.
63-
* Added support for PHPUnit 9.
64-
* Improved assertion actions to support PHPUnit 9 changes. [See assertions page for details](./docs/test/assertions.md)
65-
* Added new actions: `assertEqualsWithDelta`, `assertNotEqualsWithDelta`, `assertEqualsCanonicalizing`, `assertNotEqualsCanonicalizing`, `assertEqualsIgnoringCase`, `assertNotEqualsIgnoringCase`.
66-
* Added new actions: `assertStringContainsString`, `assertStringNotContainsString`, `assertStringContainsStringIgnoringCase`, `assertStringNotContainsStringIgnoringCase` for string haystacks.
67-
* Removed actions: `assertInternalType`, `assertNotInternalType`, `assertArraySubset`.
68-
* Removed delta option from `assertEquals` and `assertNotEquals`.
69-
* Removed action `pauseExecution` and added `pause`. [See actions page for details](./docs/test/actions.md#pause)
70-
* Removed action `formatMoney` and added `formatCurrency`. [See actions page for details](./docs/test/actions.md#formatcurrency)
71-
* Added new static check that checks and reports references to deprecated test entities.
72-
* Bumped dependencies to support PHP/PHPUnit upgrade.
73-
74-
* Traceability
75-
* Introduced new `.env` configuration `VERBOSE_ARTIFACTS` to toggle saving attachments in Allure. [See configuration page for details](./docs/configuration.md)
76-
77-
### Fixes
78-
79-
* Fixed issue of resolving arguments of type `entity` in action groups within a custom helper.
80-
* Fixed reporting issue in output file for `testDependencies` static check.
81-
* Fixed a bug in `actionGroupArguments` static check when action group filename is missing `ActionGroup`.
82-
* Fixed issue of running suites under root `_suite` directory in Standalone MFTF.
76+
* Fixed issue where an extended data entity would not merge array items. Array items should merge properly now.
77+
* Fixed issue where Chrome remains running after MFTF suite finishes.
78+
* Fixed javascript error seen on Chrome 83 for dragAndDrop action.
79+
* Fixed allure issue when `WebDriverCurlException` is encountered in `afterStep`.
8380

8481
### GitHub Issues/Pull Requests
8582

8683
* [#567](https://github.com/magento/magento2-functional-testing-framework/pull/567) -- log attachments for failed requests.
8784

88-
3.0.0 RC1
89-
---------
85+
### Demo Video links
9086

91-
### Enhancements
87+
* [MFTF 3.0.0 RC1](https://www.youtube.com/watch?v=z0ZaZCmnw-A&t=2s)
88+
* [MFTF 3.0.0 RC2](https://www.youtube.com/watch?v=BJOQAw6dX5o)
89+
* [MFTF 3.0.0 RC3](https://www.youtube.com/watch?v=scLb7pi8pR0)
9290

93-
* Customizability
94-
* Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.
95-
* Removed deprecated actions `<executeSelenium>` and `<performOn>`.
96-
* Maintainability
97-
* Schema updates for test entities to only allow single entity per file except Data and Metadata.
98-
* Support for sub-folders in test modules.
99-
* Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`.
100-
* Removed support for PHP 7.0 and 7.1.
101-
* Removed file attribute for `<module>` in suiteSchema.
102-
* Traceability
103-
* Removed `--debug` option NONE to disallow ability to turn off schema validation.
104-
* Notices added for test entity naming convention violations.
105-
* Metadata file names changed to `*Meta.xml`.
106-
* Readability
107-
* Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md)
108-
* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
109-
* Bumped dependencies to latest possible versions.
91+
2.6.4
92+
-----
11093

11194
### Fixes
112-
113-
* Throw exception during generation when leaving out .url for `amOnPage`.
114-
* `request_timeout` and `connection_timeout` added to functional.suite.yml.dist.
115-
* Fixed `ModuleResolver` to resolve test modules moved out of deprecated path.
116-
117-
### Upgrade Instructions
118-
119-
* Run `bin/mftf reset --hard` to remove old generated configurations.
120-
* Run `bin/mftf build:project` to generate new configurations.
121-
* Run `bin/mftf upgrade:tests`. [See command page for details](./docs/commands/mftf.md#upgradetests).
122-
* After running the above command, some tests may need manually updates:
123-
* Remove all occurrences of `<executeInSelenium>` and `<performOn>`
124-
* Remove all occurrences of `<module file=""/>` from any `<suite>`s
125-
* Ensure all `<assert*>` actions in your tests have a valid schema.
126-
* Lastly, try to generate all tests. Tests should all be generated as a result of the upgrades.
127-
* If not, the most likely issue will be a changed XML schema. Check error messaging and search your codebase for the attributes listed.
95+
* added dependency to packages MFTF used but never specified in composer.json
12896

12997
2.6.3
13098
-----

‎_config.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
theme: jekyll-theme-hacker

‎bin/mftf

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ try {
3131
$version = $version['version'];
3232
$application = new Symfony\Component\Console\Application();
3333
$application->setName('Magento Functional Testing Framework CLI');
34-
$application->setVersion('3.0.0');
34+
$application->setVersion($version);
3535
/** @var \Magento\FunctionalTestingFramework\Console\CommandListInterface $commandList */
3636
$commandList = new \Magento\FunctionalTestingFramework\Console\CommandList;
3737
foreach ($commandList->getCommands() as $command) {

‎composer.json

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"name": "magento/magento2-functional-testing-framework",
33
"description": "Magento2 Functional Testing Framework",
44
"type": "library",
5-
"version": "3.0.0-RC5",
5+
"version": "3.0.0",
66
"license": "AGPL-3.0",
77
"keywords": ["magento", "automation", "functional", "testing"],
88
"config": {
@@ -30,6 +30,7 @@
3030
"spomky-labs/otphp": "^10.0",
3131
"symfony/console": "^4.4",
3232
"symfony/finder": "^5.0",
33+
"symfony/http-foundation": "^5.0",
3334
"symfony/mime": "^5.0",
3435
"symfony/process": "^4.4",
3536
"vlucas/phpdotenv": "^2.4",

0 commit comments

Comments
 (0)