zephyr/scripts/tests/twister
Lukasz Fundakowski d45396a6bb twister: Cleanup twister loggers
Removed logger.setLevel(...) from all twister modules, becasue
there should be only one place where twister loggers are configured,
and the log level should be set in that place.
This should be done in twister_main.py in setup_logging function.

Signed-off-by: Lukasz Fundakowski <lukasz.fundakowski@nordicsemi.no>
2025-03-19 09:08:00 -04:00
..
pytest_integration twister: harness: introduce shell harness 2025-02-08 08:13:46 +01:00
test_data twister: Remove 'xtools' toolchain variant references 2025-01-17 10:50:07 +01:00
conftest.py twister: Cleanup twister loggers 2025-03-19 09:08:00 -04:00
README.md
test_cmakecache.py
test_config_parser.py scripts: twister: drop support for space-separated lists 2024-12-04 14:14:53 -05:00
test_environment.py
test_errors.py twister: test: update test case 2024-12-04 02:03:33 +01:00
test_handlers.py twister: handlers: Pass harness reason to instance 2024-12-17 11:37:40 +00:00
test_hardwaremap.py scripts: Fix twisterlib for ruff - UP015 2024-11-29 15:29:31 +01:00
test_harness.py twister: harness: recording: Allow multiple patterns 2025-01-16 22:38:51 +01:00
test_jobserver.py
test_log_helper.py
test_mixins.py python: Format and sort imports 2024-11-25 10:07:13 +01:00
test_platform.py twister: Account for board & SoC extensions 2025-02-14 21:01:33 +01:00
test_quarantine.py scripts: twisterlib: Enable multiple simulator support in twister 2024-11-25 08:31:28 +01:00
test_runner.py drivers entropy: fake_entropy_native_posix rename to _native_sim 2025-03-08 03:38:13 +01:00
test_scl.py
test_testinstance.py twister: support testing multiple toolchain variants 2025-01-08 12:58:59 +01:00
test_testplan.py twister: Account for board & SoC extensions 2025-02-14 21:01:33 +01:00
test_testsuite.py twister: test: update test case 2024-12-04 02:03:33 +01:00
test_twister.py scripts: Fix twisterlib for ruff - B028 2024-11-29 15:29:31 +01:00

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

  • conftest.py: Contains common fixtures for use in testing the twister tool.
  • test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
  • test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
  • test_testinstance.py : Contains testcases for Testinstance and Testcase class.
  • test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.