bartoszek/zephyr
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
56dcafece8
zephyr/scripts/tests/twister
History
Lukasz Mrugala 418b1e0e21 scripts: twister: Add TestCase status printing 
When at verbosity 1, we print out the status of TestInstances.
This makes it harder to notice changes at TestCase level,
which require perusing the logs.

This adds TestCase status and reason printing
if verbosity level is 2 or more.
Reason printing is suppressed if the reason is empty or None.

Signed-off-by: Lukasz Mrugala <lukaszx.mrugala@intel.com>
2024-09-17 15:04:04 -04:00
..
pytest_integration twister: pytest: Change the order or pytest-args 2024-08-23 15:50:19 +01:00
test_data scripts: twister: Solve deprecation notice when running tests 2024-09-12 10:03:44 +02:00
conftest.py
README.md
test_cmakecache.py
test_config_parser.py scripts: twister: check for deprecation notice for space-separated lists 2024-09-12 10:03:44 +02:00
test_environment.py scripts: twister: TwisterEnv is always used with an options parameter 2024-09-12 10:03:44 +02:00
test_errors.py scripts: twister: Elevate Status Error 2024-09-09 09:28:37 +02:00
test_handlers.py scripts: twister: handlers: Enable BinaryHandler to run sysbuilt tests 2024-09-17 09:13:26 -05:00
test_hardwaremap.py twister: hwmap: add script parameter support 2024-09-16 10:03:53 +02:00
test_harness.py gtest: Add support for gtest 1.15.0 2024-08-23 09:54:41 +02:00
test_jobserver.py scripts: twister: Fix Unit Tests on Windows systems 2024-05-15 17:08:06 +02:00
test_log_helper.py
test_mixins.py
test_platform.py twister: do not use non-existing architectures 2024-03-19 18:28:06 -04:00
test_quarantine.py
test_runner.py scripts: twister: Add TestCase status printing 2024-09-17 15:04:04 -04:00
test_scl.py
test_testinstance.py scripts: twister: Unify Twister Statuses 2024-08-12 19:23:07 -04:00
test_testplan.py twister: setup soc/arch roots based on module settings 2024-08-30 11:46:41 -04:00
test_testsuite.py scripts: twister: Unify Twister Statuses 2024-08-12 19:23:07 -04:00
test_twister.py scripts: twister: Solve deprecation notice when running tests 2024-09-12 10:03:44 +02:00

README.md

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

  • conftest.py: Contains common fixtures for use in testing the twister tool.
  • test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
  • test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
  • test_testinstance.py : Contains testcases for Testinstance and Testcase class.
  • test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.