Wrenchy Bench provides benchmarking and baselining capabilities for Opteryx.
Performance
Benchmarks performance by running queries many times to measure the execution times.
Correctness
Benchmarks correctness by comparing results of a set of statements against DuckDB's response to the same query.
Memory Consumption
https://github.com/pythonprofilers/memory_profiler
Code
this is intended to assist with debugging performance issues.
https://github.com/pyutils/line_profiler
https://github.com/tripl-ai/tpch, MIT Licence