OS Testing

Jump to bottom Edit New page

Sergey Bronnikov edited this page Jul 10, 2020 · 3 revisions

Портируемость

binfmt_misc
QEMU
Запуск ядра ОС в пространстве пользователя:
User-Mode Linux
RUMP, RUMP Kernel Book

Rent Hardware

CPU	URL	Price
Baikal	https://baik.al/	Free
Cavium	https://www.packet.net/bare-metal/servers/	0.07-2$ USD
ARM	https://www.packet.net/bare-metal/servers/	-
Power	https://www.ibm.com/cloud/bare-metal-servers/power	-
Scaleway	https://www.scaleway.com/baremetal-cloud-servers/	-
MIPS	https://cloud.oracle.com/tryit?intcmp=ocom-cloud	-

Также см. https://github.com/sanxiyn/blog/blob/master/posts/2019-11-12.md

Двоичная совместимость

ABI Compliance Checker — a tool for checking backward binary and source-level compatibility of a C/C++ software library
ABI Dumper - a tool to dump ABI of an ELF object containing DWARF debug info
icheck - C interface ABI/API checker
BCS - The Symbian binary compatibility suite
shlib-compat - ABI compatibility checker that uses DWARF debug info
qbic - A tool to check for binary incompatibilities in Qt4 Toolkit
libabigail - A C++ library for ABI analysis
chkshlib, cmpdylib, cmpshlib - Tools to compare binary symbols
abicheck
https://github.com/MattPD/cpplinks/blob/master/interoperability.portability.md#abi

Stress

sysutils/stress
sysutils/torture
sysutils/fsstress
sysutils/iogen
xenocara/app/x11perf
fstorture
benchmark
entropy
dieharder - WIP port
hackbench
misc/vttest
security/isic
sysutils/memtester
sysutils/memtest86+
x11/rendercheck
www/slowhttptest
nfstest - sysutils/nfstest
NFSometer
stress2 - sysutils/stress2
dEQP - DrawElements Quality Program (FOSDEM)
http://pracrand.sourceforge.net/
File System Stress Testing Framework
blktests
ffsb
smtpscript
dnsblast
dnsperf https://github.com/DNS-OARC/dnsperf
charybdefs

Почта postal https://doc.coker.com.au/projects/postal/
Почта postmark https://koala.cs.pub.ro/redmine/attachments/download/605/Katcher97-postmark-netapp-tr3022.pdf
Firewall https://github.com/regit/opensvp
GUI https://git.yoctoproject.org/cgit.cgi/matchbox-tests/ Xnee
Crypto https://github.com/jedisct1/supercop
Database pgbench

Hardware

CPU https://github.com/cirosantilli/dhrystone
Video glean
Video intel-gpu-tools
Video graphics/piglit

Video SpecView https://www.spec.org/gwpg/downloadindex.html
Video intel-gpu-testsuite https://github.com/freedesktop/xorg-intel-gpu-tools
Video qtperf https://github.com/shuttie/qtperf
Video qgears https://zrusin.blogspot.com/2008/08/fast-graphics.html
Video gtkperf http://gtkperf.sourceforge.net/

Video cairogears

Video https://github.com/jar/c-ray-1.1-coprthr2>
Video c-ray https://github.com/jar/c-ray-1.1-coprthr2
Video smallpt
- https://github.com/matt77hias/smallpt
- http://www.kevinbeason.com/smallpt/
Video Windows: dxdiag.exe
Video Linux: glxgears

Filesystem https://github.com/gkostka/lwext4/tree/master/fs_test
Filesystem crashmonkey
Filesystem XFS tests
Filesystem https://github.com/tytso/xfstests-bld
Filesystem fsx
Filesystem https://github.com/ARMmbed/littlefs/tree/master/tests
Filesystem fio
Filesystem https://github.com/billziss-gh/winfsp/tree/master/tst/winfsp-tests
Network nemesis - a command-line network packet crafting and injection utility
Network isic
Network trex
Network iperf, netperf or nuttcp, mz
Network mininet - эмуляция компьютерной сети, например для тестирования сложных сетевых протоколов, simnet
Network https://github.com/mtcp-stack/mtcp
Network http://dunkels.com/adam/twip.html
Network http://git.savannah.nongnu.org/cgit/lwip.git/tree/test
USB TTCN: https://git.osmocom.org/titan.TestPorts.USB/about/
USB MUTT (https://docs.microsoft.com/en-us/windows-hardware/drivers/usbcon/usb-driver-testing-guide)
"USB Reverse Engineering: Down the rabbit hole"
USB Facedancer
- umap documentation
USB EZUSB
USB NGW100
USB Tomu (see tomu-samples)
USB "Massive Scale USB Device Driver Fuzz WITHOUT device": slides, video
ACPI https://wiki.ubuntu.com/FirmwareTestSuite

Батарея https://01.org/powertop/
Батарея powercfg.exe -energy
Батарея Win: BatteryEater
Батарея BLTK https://www.systutorials.com/docs/linux/man/1-bltk/

Conformance Tests (System Libraries and Interfaces)

TCP packetdrill:
TCP TTCN-3 and [intel/net-test-suites](https://github.com/intel/net-test- suites), zephyrproject-rtos/net-tools, echo server - https://github.com/zephyrproject-rtos/zephyr/tree/master/samples/net/sockets/echo_server/src
POSIX Conformance https://github.com/mpieuchot/libpthread-regress
POSIX Conformance modernish - Library for writing robust, portable, readable, and powerful programs for POSIX-based shells and utilities.
POSIX Conformance https://sortix.org/os-test/
POSIX Conformance ~~Open Posix Tests~~
POSIX Conformance POSIX regex, re_bench
POSIX Conformance PCTS:151-2, POSIX Test Suite
POSIX Conformance https://git.musl-libc.org/cgit/libc-testsuite/
POSIX Conformance https://github.com/linux-test-project/ltp/tree/master/testcases/open_posix_testsuite/conformance/interfaces
POSIX Conformance Using a model-based test generator to test for standard conformance (10 vs 12 person months)
POSIX Conformance https://github.com/daanx/mimalloc-bench
mimalloc tests

Testing of operating systems

Android cs.android.com
ZephyrOS github.com/zephyrproject-rtos/zephyr-testing
SEL4 https://github.com/seL4/sel4test/blob/master/apps/sel4test-tests/
OpenBSD https://github.com/ligurio/openbsd-tests/wiki
FreeBSD QA community
FreeBSD regression tests: tools/regression, tests
FreeBSD FreeBSD Test Cluster Automation -- Kamil Czekirda
NetBSD regression tests: src/regress
DragonFlyBSD regression tests: tools/regression and test
Android network regression tests: https://android.googlesource.com/kernel/tests/+/sdk-release/net/
ChromeOS GTAC 2015: Chrome OS Test Automation Lab
ChromeOS https://chromium.googlesource.com/chromiumos/third_party/autotest/+/master/client/tests/
Solaris regression tests: https://bitbucket.org/illumos/illumos-stc
Linux Putting LTP to test—Validating both the Linux kernel and Test-cases
Linux Building a Robust Linux kernel piggybacking The Linux Test Project
Linux https://launchpad.net/qa-regression-testing

Copyright © 2014-2025 Sergey Bronnikov. Follow me on Mastodon @sergeyb@honk.bronevichok.ru and Telegram.