zephyr/scripts
Dmitrii Golovanov a72244f2d0 twister: ztest: harness: Fix missed TestCase statuses
Fix a problem of Ztest suite names not taken into account by Twister
to identify a TestCase, so in some situations a Ztest test's status
was not assigned to the proper TestCase and it remains 'None'
whereas the actual status value lost, eventually the resulting total
execution counters not correct.

The issue was observed in these situations:
 * Ztest application with multiple test suites having same test names.
 * Ztest suite is 'skipped' entirely on execution with all its tests.

The proposed solution extends Twister test case name for Ztest to
include Ztest suite name, so the resulting identifier looks like:
   `<test_scenario_name>.<ztest_suite_name>.<ztest_name>`

The above naming scheme now requires ztest_suite_name part to be
provided for `--sub-test` command line option.

Testcase identifiers in twister.json and testplan.json will also
include ztest_suite_name component.

The Twister Ztest(Test) Harness is improved to track all state changes
known from the test application's log for Ztest suites and test cases,
so now it parses log output from a Ztest application more scurpulously.
Regular expressions to match log records are extended and optimized
to compile them only once and, in some cases, fixed (suite summary).

Signed-off-by: Dmitrii Golovanov <dmitrii.golovanov@intel.com>
2024-11-22 08:26:59 -05:00
..
build python: Format trivial files where only newlines were missing 2024-11-21 20:10:51 +01:00
checkpatch scripts: checkpatch: add NRF_GPIO_Type to typedefs file 2024-11-01 12:10:12 -05:00
ci ci: testplan: do not deal with arch changes 2024-11-19 22:25:18 -05:00
coccinelle scripts: coccinelle: add errno as a reserved name 2024-08-22 14:21:53 -04:00
coredump python: Format trivial files where only newlines were missing 2024-11-21 20:10:51 +01:00
dts python: Format trivial files where only newlines were missing 2024-11-21 20:10:51 +01:00
footprint ci: footprint: fix nrf5340dk/nrf5340/cpuapp board name 2024-10-25 14:08:18 +02:00
generate_usb_vif
gitlint
kconfig cmake: scripts: support board extension 2024-10-26 17:14:06 +02:00
logging/dictionary python: Format trivial files where only newlines were missing 2024-11-21 20:10:51 +01:00
native_simulator native_simulator: Get latest from upstream 2024-10-24 17:01:50 +01:00
net
profiling scripts: profiling: Add stackcollapse script 2024-08-13 18:28:44 -04:00
pylib twister: ztest: harness: Fix missed TestCase statuses 2024-11-22 08:26:59 -05:00
pylint/checkers
release
ruff scripts: Add helper scripts for ruff baseline excludes 2024-11-19 18:36:54 -05:00
schemas twister: Allow sharing hardware platform between variants 2024-11-21 14:48:03 +01:00
support
tests twister: ztest: harness: Fix missed TestCase statuses 2024-11-22 08:26:59 -05:00
tracing tracing: add named event trace 2024-10-17 10:46:52 -04:00
utils scripts: Read yaml files using utf-8 encoding 2024-10-17 09:43:16 +02:00
west_commands python: Format trivial files where only newlines were missing 2024-11-21 20:10:51 +01:00
.gitignore
check_maintainers.py scripts: check_maintainers: add scripts for checking GitHub accounts 2024-11-06 09:53:52 -08:00
checkpatch.pl scripts: checkpatch.pl: treat .overlay files as dts 2024-06-21 08:46:12 -04:00
checkstack.pl
coccicheck
dump_bugs_pickle.py
gen_gcov_files.py
get_maintainer.py scripts: get_maintainer: check maintenance status 2024-06-28 07:19:49 -04:00
github_helpers.py
list_boards.py scripts: Undo Board.{dir -> directories[0]} renames 2024-10-26 17:14:06 +02:00
list_hardware.py scripts: list_hardware: Do not check qualifiers for run once config 2024-10-26 17:14:06 +02:00
list_shields.py
make_bugs_pickle.py ci: scripts: do not count PRs labeled as bug in snapshot 2024-07-12 16:10:13 -04:00
requirements-base.txt commands: add the 'sdk' command to manage SDK. 2024-08-21 16:54:56 -04:00
requirements-build-test.txt
requirements-compliance.txt scripts: ci: check_compliance: Add python lint/format check 2024-11-19 18:36:54 -05:00
requirements-extras.txt scripts: footprint: Add converter to twister_footprint.json 2024-09-19 03:28:52 -04:00
requirements-run-test.txt scripts: Remove wrong bz package 2024-09-23 09:59:56 +02:00
requirements.txt
series-push-hook.sh
set_assignees.py ci: set_assignee: pick next area when submitter = assignee 2024-07-10 19:14:17 -04:00
snippets.py
spelling.txt scripts: RISCV instruction SEPC 2024-08-27 10:48:58 -04:00
tags.sh
twister scripts: twister: Python Version Guard 2024-11-04 17:24:24 -05:00
valgrind.supp
west-commands.yml west: runners: Add west rtt command with pyocd implementation 2024-09-10 12:39:42 -04:00
zephyr_module.py scripts: Read yaml files using utf-8 encoding 2024-10-17 09:43:16 +02:00