History

Dmitrii Golovanov b69a8d1deb twister: ztest: short test case names on --no-detailed-test-id Extend `--no-detailed-test-id` command line option: in addition to its current behavior to exclude from a test Suite name its configuration path prefix, also don't prefix each Ztest Case name with its Scenario name. For example: 'kernel.common.timing' Scenario name, the same Suite name, and 'sleep.usleep' test Case (where 'sleep' is its Ztest suite name and 'usleep' is Ztest test name. This way both TestSuite and TestCase names follow the same principle having no parent object name prefix. There is no information loss in Twister reports with this naming: TestSuite is a container object for its TestCases, whereas TestSuite has its configuration path as a property. Signed-off-by: Dmitrii Golovanov <dmitrii.golovanov@intel.com>		2024-12-16 08:35:34 +01:00
..
pytest_integration	twister: Pass extra test args to pytest	2024-12-12 10:20:55 -05:00
test_data	python: Format trivial files where only newlines were missing	2024-11-21 20:10:51 +01:00
conftest.py
README.md
test_cmakecache.py
test_config_parser.py	scripts: twister: drop support for space-separated lists	2024-12-04 14:14:53 -05:00
test_environment.py	scripts: Fix CMake spelling	2024-10-30 16:32:24 -05:00
test_errors.py	twister: test: update test case	2024-12-04 02:03:33 +01:00
test_handlers.py	twister: test: update test case	2024-12-04 02:03:33 +01:00
test_hardwaremap.py	scripts: Fix twisterlib for ruff - UP015	2024-11-29 15:29:31 +01:00
test_harness.py	twister: ztest: short test case names on --no-detailed-test-id	2024-12-16 08:35:34 +01:00
test_jobserver.py
test_log_helper.py
test_mixins.py	python: Format and sort imports	2024-11-25 10:07:13 +01:00
test_platform.py	scripts: twisterlib: Enable multiple simulator support in twister	2024-11-25 08:31:28 +01:00
test_quarantine.py	scripts: twisterlib: Enable multiple simulator support in twister	2024-11-25 08:31:28 +01:00
test_runner.py	twister: ztest: short test case names on --no-detailed-test-id	2024-12-16 08:35:34 +01:00
test_scl.py
test_testinstance.py	scripts: Fix twisterlib for ruff - UP015	2024-11-29 15:29:31 +01:00
test_testplan.py	twister: testplan: Detect duplicates on `--no-detailed-test-id`	2024-11-27 08:19:39 +01:00
test_testsuite.py	twister: test: update test case	2024-12-04 02:03:33 +01:00
test_twister.py	scripts: Fix twisterlib for ruff - B028	2024-11-29 15:29:31 +01:00

README.md

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

conftest.py: Contains common fixtures for use in testing the twister tool.
test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
test_testinstance.py : Contains testcases for Testinstance and Testcase class.
test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.