Closed
Description
Description of defect
When running Mbed OS USB Device tests, there are several failures. Some seem intermittent, such as tests-usb_device-basic, which on some instances will all pass. However, mostly the results are very consistent. It also seems consistent across all toolchains. Full logs are attached.
Target(s) affected by this defect ?
NRF52840_DK, EP_AGORA
Toolchain(s) (name and version) displaying this defect ?
ARM, IAR
Didn't test GCC_ARM, but suspect same result
What version of Mbed-os are you using (tag or sha) ?
Mbed OS 5.14.2
What version(s) of tools are you using. List all that apply (E.g. mbed-cli)
Windows 7 test machine
Zadig libusb-win32 (v1.2.6.0) driver
mbed-cli (1.10.0)
mbed-clitest (0.21.0)
mbed-cloud-sdk (2.0.8)
mbed-flasher (0.10.1)
mbed-greentea (1.7.2)
mbed-host-tests (1.5.8)
mbed-ls (1.7.8)
mbed-os-tools (0.0.9)
How is this defect reproduced ?
- Clone Mbed OS
- Connect usb cable for debug interface, connect usb cable for target usb
- Set up environment (installer Zadig drivers) pr mbed-os\TESTS\usb_device\README.md
- Run tests with the following command
mbed test -m NRF52840_DK -t ARM -n tests-usb_device*
Results
| target | platform_name | test suite | test case | passed | failed | result | elapsed_time (sec) |
|-------------------|---------------|-------------------------|-------------------------------------------------|--------|--------|---------|--------------------|
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test abort | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test data correctness | 1 | 0 | OK | 1.39 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test data toggle reset | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test halt | 0 | 1 | FAIL | 8.58 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test parallel transfers | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | endpoint test parallel transfers ctrl | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb control basic test | 1 | 0 | OK | 3.93 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb control sizes test | 1 | 0 | OK | 0.47 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb control stall test | 1 | 0 | OK | 0.38 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb control stress test | 1 | 0 | OK | 0.53 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb device reset test | 1 | 0 | OK | 1.95 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb repeated construction destruction test | 1 | 0 | OK | 2.3 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-basic | usb soft reconnection test | 1 | 0 | OK | 1.78 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Configuration descriptor, generic | 0 | 0 | ERROR | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Configuration descriptor, keyboard | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Configuration descriptor, mouse | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | HID class descriptors, generic | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | HID class descriptors, keyboard | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | HID class descriptors, mouse | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Raw input/output, 1-byte reports | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Raw input/output, 20-byte reports | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-hid | Raw input/output, 64-byte reports | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-msd | mount/unmount and data test - Heap block device | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-msd | mount/unmount test - Heap block device | 0 | 1 | FAIL | 49.95 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-msd | storage initialization | 1 | 0 | OK | 0.04 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC RX multiple bytes | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC RX multiple bytes concurrent | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC RX single bytes | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC RX single bytes concurrent | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC USB reconnect | 0 | 0 | ERROR | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | CDC loopback | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | Serial USB reconnect | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | Serial getc | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | Serial line coding change | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | Serial printf/scanf | 0 | 0 | SKIPPED | 0.0 |
| NRF52840_DK-ARMC6 | NRF52840_DK | tests-usb_device-serial | Serial terminal reopen | 0 | 0 | SKIPPED | 0.0 |
mbedgt: test case results: 2 FAIL / 23 SKIPPED / 9 OK / 2 ERROR
| target | platform_name | test suite | test case | passed | failed | result | elapsed_time (sec) |
|----------------|---------------|-------------------------|-------------------------------------------------|--------|--------|---------|--------------------|
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test abort | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test data correctness | 1 | 0 | OK | 1.5 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test data toggle reset | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test halt | 0 | 1 | FAIL | 7.68 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test parallel transfers | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | endpoint test parallel transfers ctrl | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb control basic test | 1 | 0 | OK | 3.32 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb control sizes test | 1 | 0 | OK | 0.43 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb control stall test | 1 | 0 | OK | 0.36 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb control stress test | 1 | 0 | OK | 0.48 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb device reset test | 1 | 0 | OK | 2.09 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb repeated construction destruction test | 1 | 0 | OK | 2.28 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-basic | usb soft reconnection test | 1 | 0 | OK | 1.67 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Configuration descriptor, generic | 0 | 0 | ERROR | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Configuration descriptor, keyboard | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Configuration descriptor, mouse | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | HID class descriptors, generic | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | HID class descriptors, keyboard | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | HID class descriptors, mouse | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Raw input/output, 1-byte reports | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Raw input/output, 20-byte reports | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-hid | Raw input/output, 64-byte reports | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-msd | mount/unmount and data test - Heap block device | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-msd | mount/unmount test - Heap block device | 0 | 1 | FAIL | 48.42 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-msd | storage initialization | 1 | 0 | OK | 0.07 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC RX multiple bytes | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC RX multiple bytes concurrent | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC RX single bytes | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC RX single bytes concurrent | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC USB reconnect | 0 | 0 | ERROR | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | CDC loopback | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | Serial USB reconnect | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | Serial getc | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | Serial line coding change | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | Serial printf/scanf | 0 | 0 | SKIPPED | 0.0 |
| EP_AGORA-ARMC6 | EP_AGORA | tests-usb_device-serial | Serial terminal reopen | 0 | 0 | SKIPPED | 0.0 |
mbedgt: test case results: 2 FAIL / 23 SKIPPED / 9 OK / 2 ERROR
nrf52840_usb_tests_log_20Nov2019_3.txt
nrf52840_usb_tests_log_20Nov2019.txt