Application Verifier Dynamic Fault Injection

vfdynf.dll is an application verifier provider that implements unique-stack based systematic fault injection to simulate low resource scenarios, fuzz resource access, and generally extend the capabilities of application verifier.

The integration also works with the command line (the TEST type is DynFault):

appverif DynFault ... -for TARGET ... [-with [TEST.]PROPERTY=VALUE ...]

Fault Injection

"Dynamic Fault Injection" (DynFault) is a replacement for "Low Resource Simulation" (LowRes) tests. LowRes is a probability-based (randomized) fault injection. In contrast, DynFault tracks stack hashes when determining where to inject faults. This provides better coverage when simulating low resource scenarios. DynFault injects failures for wait, heap, virtual memory, registry, file, event, section, and OLE string APIs. These are the same APIs as LowRes.

The ability to exclude modules in LowRes is limited. DynFault, in contrast, enables you to exclude stacks containing symbols matched by a set of regular expressions. Why is this helpful? I'll provide an example, which was the impetus for me reversing the undocumented parts of verifier to implement this library. MSVC implemented debug iterators which are valuable to identify bugs but break noexcept contracts. For example, the default std::string constructor is marked noexcept but with debug iterators enabled an allocation could occur within it and throw an exception. The cpp exception handling then can't locate a handler past noexcept. The contract is such that if an exception would cross that boundary the implementation should terminate the program. Hopefully you can see the problem with the limited functionality of LowRes (you can't use it with debug iterators). To solve this DynFault has a property that allows you to define a list of regular expressions. When DynFault encounters a stack matching any expression in this list, that stack hash is excluded from fault injection. As an example, this regular expression tries to isolate stacks containing std::basic_string's default constructor:

\s.*!.*_Alloc_proxy<.*>\s.*!std::basic_string<.*>::basic_string<.*>\s

The above regular expression will match on this stack:

testdynf.exe!heap_alloc_dbg_internal
testdynf.exe!heap_alloc_dbg
testdynf.exe!_malloc_dbg
testdynf.exe!malloc
testdynf.exe!operator new
testdynf.exe!std::_Default_allocate_traits::_Allocate
testdynf.exe!std::_Allocate<16,std::_Default_allocate_traits,0>
testdynf.exe!std::allocator<std::_Container_proxy>::allocate
testdynf.exe!std::_Container_base12::_Alloc_proxy<std::allocator<std::_Container_proxy> >
testdynf.exe!std::basic_string<char,std::char_traits<char>,std::allocator<char> >::basic_string<char,std::char_traits<char>,std::allocator<char> >
testdynf.exe!main
testdynf.exe!invoke_main
testdynf.exe!__scrt_common_main_seh
testdynf.exe!__scrt_common_main
testdynf.exe!mainCRTStartup
KERNEL32.dll!BaseThreadInitThunk
ntdll.dll!RtlUserThreadStart

Enabling the best of both worlds - debug iterators and fault injection!

Fuzzing

DynFault also supports fuzzing! The fuzzing options are disabled by default. To enable them, add the relevant bits to the EnableFaultMask property. You can use the same exclusions to exclude stacks from fuzzing as you would other fault types. DynFault can fuzz registry reads, file reads, section mappings, and network receives. The fuzzing approach attempts to classify and corrupt buffers in a targeted manner but also has a configurable probability of chaotic corruption. Fuzzing only corrupts buffers and values returned to the application from the operating system. The intention is to catch and identify programming errors and security vulnerabilities caused by making assumptions around integrity of data or time of check time of use.

DynFault Properties (Options)

Name	Type	Description
GracePeriod	DWORD	Delays fault injection until after this period, in milliseconds.
SymbolSearchPath	String	Symbol search path used for dynamic fault injection and applying exclusions.
IncludeRegex	String	Includes fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
ExclusionsRegex	MultiString	Excludes stack from fault injection when one of these regular expression matches the stack.
DynamicFaultPeriod	DWORD	Clears dynamic stack fault injection tracking on this period, in milliseconds, zero does not clear tracking.
EnableFaultMask	QWORD	Mask of which fault types are enabled. Bit 1=Wait, 2=Heap, 3=VMem, 4=Reg, 5=File, 6=Event, 7=Section, 8=Ole, 9=InPage, 10=FuzzReg, 11=FuzzFile, 12=FuzzMMap, 13=FuzzNet.
FaultProbability	DWORD	Probability that a fault will be injected (0 - 1000000).
FaultSeed	DWORD	Seed used for fault randomization. A value of zero will generate a random seed.
FuzzCorruptionBlocks	DWORD	Maximum number of blocks to corrupt when fuzzing. Larger numbers will impact performance, fuzzing logic will randomly loop between one and this maximum to apply corruption techniques on buffers.
FuzzChaosProbability	DWORD	The probability (0 - 1000000) a corruption block will overwrite a portion of buffer with random data. Otherwise various corruption techniques are applied to the buffer in a less chaotic manner.
FuzzSizeTruncateProbability	DWORD	The probability (0 - 1000000) that data lengths will be truncated to a random value below the actual length of the output data.
HeapReasonableAllocLimit	QWORD	Limit which is considered a reasonable single heap allocation. If the size a single heap allocation exceeds this limit a verifier stop is raised.
StopRegex	String	Regular expression to check against the immediate caller module name when a verifier stop is about to be raised. If the module does not match this regular expression the verifier stop does not occur. Defaults to matching only the application module.
WaitIncludeRegex	MultiString	Includes wait fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
HeapIncludeRegex	MultiString	Includes heap fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
VMemIncludeRegex	MultiString	Includes virtual memory fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
RegIncludeRegex	MultiString	Includes registry fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
FileIncludeRegex	MultiString	Includes file fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
EventIncludeRegex	MultiString	Includes event fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
SectionIncludeRegex	MultiString	Includes section fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
OleIncludeRegex	MultiString	Includes OLE fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
InPageIncludeRegex	MultiString	Includes in-page fault injection for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
FuzzRegIncludeRegex	MultiString	Includes file fuzzing for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
FuzzFileIncludeRegex	MultiString	Includes file fuzzing for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
FuzzMMapIncludeRegex	MultiString	Includes section map fuzzing for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
FuzzNetIncludeRegex	MultiString	Includes network fuzzing for the immediate calling module when this regular expression matches the module name. When not provided all modules are included.
WaitExclusionsRegex	MultiString	Excludes stack from wait fault injection when one of these regular expression matches the stack.
HeapExclusionsRegex	MultiString	Excludes stack from heap fault injection when one of these regular expression matches the stack.
VMemExclusionsRegex	MultiString	Excludes stack from virtual memory fault injection when one of these regular expression matches the stack.
RegExclusionsRegex	MultiString	Excludes stack from registry fault injection when one of these regular expression matches the stack.
FileExclusionsRegex	MultiString	Excludes stack from file fault injection when one of these regular expression matches the stack.
EventExclusionsRegex	MultiString	Excludes stack from event fault injection when one of these regular expression matches the stack.
SectionExclusionsRegex	MultiString	Excludes stack from section fault injection when one of these regular expression matches the stack.
OleExclusionsRegex	MultiString	Excludes stack from OLE fault injection when one of these regular expression matches the stack.
InPageExclusionsRegex	MultiString	Excludes stack from section in-page fault injection when one of these regular expression matches the stack.
FuzzRegExclusionsRegex	MultiString	Excludes stack from registry fuzzing when one of these regular expression matches the stack.
FuzzFileExclusionsRegex	MultiString	Excludes stack from file fuzzing when one of these regular expression matches the stack.
FuzzMMapExclusionsRegex	MultiString	Excludes stack from section map fuzzing when one of these regular expression matches the stack.
FuzzNetExclusionsRegex	MultiString	Excludes stack from network fuzzing when one of these regular expression matches the stack.

Installation

Install DynFault using application verifier by providing the DLL to appverf.exe using the -installprovider option. Alternatively, you can manually install the DLL and configure application verifier in the registry.

x64 Host

> C:\Windows\System32\appverif.exe -installprovider .\Release.x64\vfdynf.dll
> C:\Windows\SysWOW64\appverif.exe -installprovider .\Release.x86\vfdynf.dll

ARM64 Host

> C:\Windows\System32\appverif.exe -installprovider .\Release.ARM64EC\vfdynf.dll
> C:\Windows\SysWOW64\appverif.exe -installprovider .\Release.x86\vfdynf.dll

x86 Host

> C:\Windows\System32\appverif.exe -installprovider .\Release.x86\vfdynf.dll

Manual

1. Copy vfdynf.dll to C:\Windows\System32 (and SysWOW64 as appropriate).
2. Add vfdynf.dll to the "Application Verifier Global Settings" "Verified Providers" list (again WOW6432Node as appropriate).

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Image File Execution Options\{ApplicationVerifierGlobalSettings}]
"VerifierProviders"="vrfcore.dll vfbasics.dll vfcompat.dll vfluapriv.dll vfprint.dll vfnet.dll vfntlmless.dll vfnws.dll vfcuzz.dll vfdynf.dll"

Building

The repo uses submodules, after cloning be sure to init and update the submodules.

git clone https://github.com/jxy-s/vfdynf
cd .\vfdynf\
git submodule update --init --recursive
MSBuild .\vfdynf.sln

Credits

The following are used without modification. Credits to their authors.

• System Informer Native API Headers Collection of Native API header files. Gathered from Microsoft header files and symbol files, as well as a lot of reverse engineering and guessing.

• PCRE2 - Perl-Compatible Regular Expressions The PCRE2 library is a set of C functions that implement regular expression pattern matching using the same syntax and semantics as Perl 5. PCRE2 has its own native API, as well as a set of wrapper functions that correspond to the POSIX regular expression API. The PCRE2 library is free, even for building proprietary software. It comes in three forms, for processing 8-bit, 16-bit, or 32-bit code units, in either literal or UTF encoding.

And, Grandfather Derpington ;)