-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Mbed] Add integration tests for example applications #12039
Merged
woody-apple
merged 27 commits into
project-chip:master
from
ARMmbed:mbed-os-integration-tests
Nov 30, 2021
Merged
[Mbed] Add integration tests for example applications #12039
woody-apple
merged 27 commits into
project-chip:master
from
ARMmbed:mbed-os-integration-tests
Nov 30, 2021
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
PR #12039: Size comparison from dcca930 to f45c04b Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
ATmobica
force-pushed
the
mbed-os-integration-tests
branch
from
November 23, 2021 09:04
f45c04b
to
0686f46
Compare
PR #12039: Size comparison from b83502b to 0686f46 Full report (21 builds for efr32, k32w, linux, p6, qpg, telink)
|
PR #12039: Size comparison from 79fe72a to c8165ff Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
ATmobica
force-pushed
the
mbed-os-integration-tests
branch
from
November 23, 2021 11:47
c8165ff
to
fe879dc
Compare
PR #12039: Size comparison from 79fe72a to fe879dc Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
PR #12039: Size comparison from 3872a50 to 8c48972 Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
PR #12039: Size comparison from 15929eb to e9ed30f Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
Add integration test dir and files Cahnge unit test path in launch.json, task.json and mbed_unit_tests.sh
Update lock and lightings apps smoke tests
Add utlis file with common ble and wifi functions Add wifi provisioning test
Update wifi provisioning tests
Add Pigweed-app integration test and pigweed client
Improve unit tests check
Add access point as fixture Use AP in shell wifi connect test
Improve unit-test checking
pullapprove
bot
requested review from
Damian-Nordic,
electrocucaracha,
emargolis,
franck-apple,
hawk248,
holbrookt,
jelderton,
jepenven-silabs,
jmartinez-silabs,
kghost,
kpschoedel,
LuDuda,
lzgrablic02,
mlepage-google,
msandstedt,
pan-apple,
robszewczyk,
sagar-apple,
saurabhst,
selissia,
tecimovic,
turon,
vivien-apple,
wbschiller and
woody-apple
November 26, 2021 11:30
woody-apple
approved these changes
Nov 30, 2021
Fast tracking given this is a platform maintainer, updating their platform. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Problem
For better applications validation the integration tests are necessary. We prepared the Mbed version of integration tests which allows some examples validation and check regressions.
Everything happens at a system level on real hardware. The host machine running the tests should be connected to the board under test via serial port. The tests send a succession of commands to the connected boards or trigger external tools action that changes the device state and asserts the results reported by the hardware.
The Mbed integration tests are coded in Python and use the pyTest framework. This also allows for easy integration with external CHIP tools.
Change overview
Add Mbed integration tests for lighting-app, lock-app, shell, pigweed-app and unit-tests
Improve /test_driever/mbed directory tree
Add pytest and mbed-ls to Pigweed requirements (mbed specific)
Add mount_new_mbed_device,sh script for mounting Mbed target in the right place.
These changes require the inclusion of other pull requests:
Testing
Run Mbed integration tests [see README file]