zephyr/tests/kernel
Marc Herbert 4afcc0f8af sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup
- Delete CONFIG_TEST_USERSPACE=n no-ops because it's the default
since commit 7b1ee5cf13

- Some tests have a "userspace" tag pretending to TEST_USERSPACE but
don't and vice versa: fix missing or spurious "userspace" tags in
testcase.yaml files.

Tests have a _spurious_ "userspace" tag when they PASS this command
cause none should pass:

  ./scripts/sanitycheck --tag=userspace -p qemu_x86 \
      --extra-args=CONFIG_TEST_USERSPACE=n  \
      --extra-args=CONFIG_USERSPACE=n | tee userspace.log

All tests run by this command must either fail to build or fail to run
with some userspace related error. Shortcut to look at all test
failures:

 zephyr_failure_logs() {
     awk '/see.*log/ {print $2}' "$@"
 }

Tests _missing_ "userspace" tag FAIL to either build or to run with some
userspace related error when running this:

  ./scripts/sanitycheck --exclude=userspace -p qemu_x86 \
      --extra-args=CONFIG_TEST_USERSPACE=n  \
      --extra-args=CONFIG_USERSPACE=n | tee excludeuserspace.log

Note the detection methods above are not 100% perfect because some
flexible tests like tests/kernel/queue/src/main.c evade them with #ifdef
CONFIG_USERSPACE smarts. Considering they never break, it is purely the
test author's decision to include or not such flexible tests in the
"userspace" subset.

Signed-off-by: Marc Herbert <marc.herbert@intel.com>
2019-05-30 08:45:39 -04:00
..
arm_irq_vector_table tests: adjust stack size for mps2_an385's coverage test 2019-04-11 17:59:39 -04:00
arm_runtime_nmi license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
boot_page_table license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
common tests: kernel: common: add missing userspace tag 2019-05-26 08:56:08 -04:00
context drivers: timer: add LiteX timer driver 2019-05-15 12:52:16 -05:00
critical sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
device tests/kernel/device: extends test for code coverage 2019-05-01 10:38:03 -04:00
early_sleep license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
fatal sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
fifo license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
fp_sharing tests: kernel: fp_sharing: minor fix in #ifdef expression 2019-04-10 10:59:46 -04:00
gen_isr_table tests: kernel: Exclude platforms stm32_min_dev_* 2019-04-26 03:34:45 -07:00
interrupt tests: kernel: Exclude platforms stm32_min_dev_* 2019-04-26 03:34:45 -07:00
lifo sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
mbox license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
mem_heap/mheap_api_concept license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
mem_pool tests: adjust stack size for mps2_an385's coverage test 2019-04-11 17:59:39 -04:00
mem_protect tests: kernel: increase stack buffer when code coverage enabled 2019-05-16 09:29:55 -07:00
mem_slab license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
mp license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
msgq/msgq_api license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
mutex tests: adjust stack size for mps2_an385's coverage test 2019-04-11 17:59:39 -04:00
obj_tracing license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
pending license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
pipe tests: pipe: fix error with optimization disabled 2019-05-02 07:22:37 -04:00
poll license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
profiling/profiling_api tests: adjust stack size for mps2_an385's coverage test 2019-04-11 17:59:39 -04:00
queue license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
sched tests: test_sched_timeslice_reset: Fix slice time measurement 2019-05-23 09:28:58 -04:00
semaphore license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
sleep tests/kernel/sleep: add tests for k_usleep() API 2019-05-21 23:09:16 -04:00
smp license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
spinlock license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
stack license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
static_idt license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
threads tests: adjust stack size for mps2_an385's coverage test 2019-04-11 17:59:39 -04:00
tickless tests: tickless_concept: Fix slicing time measurement 2019-05-23 09:28:58 -04:00
timer sanitycheck: CONFIG_TEST_USERSPACE / userspace tag cleanup 2019-05-30 08:45:39 -04:00
workq license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00
xip license: cleanup: add SPDX Apache-2.0 license identifier 2019-04-07 08:45:22 -04:00