Profile / Benchmarking policies

[garethahealy]

Look into:

• https://www.openpolicyagent.org/docs/latest/policy-performance/#profiling

Could this be added as part of the CI?

[garethahealy]

$ opa bench --bundle policy/ --input policy/ocp/bestpractices/common-k8s-labels-notset/test_data/unit/list.yml "data.ocp.bestpractices.common_k8s_labels_notset"
+-------------------------------------------+------------+
| samples                                   |      14152 |
| ns/op                                     |      85223 |
| B/op                                      |      41718 |
| allocs/op                                 |        786 |
| histogram_timer_rego_query_eval_ns_75%    |      76590 |
| histogram_timer_rego_query_eval_ns_90%    |      86340 |
| histogram_timer_rego_query_eval_ns_95%    |      96418 |
| histogram_timer_rego_query_eval_ns_99%    |     302869 |
| histogram_timer_rego_query_eval_ns_99.9%  |     479065 |
| histogram_timer_rego_query_eval_ns_99.99% |     479783 |
| histogram_timer_rego_query_eval_ns_count  |      14152 |
| histogram_timer_rego_query_eval_ns_max    |     479783 |
| histogram_timer_rego_query_eval_ns_mean   |      78770 |
| histogram_timer_rego_query_eval_ns_median |      70684 |
| histogram_timer_rego_query_eval_ns_min    |      64479 |
| histogram_timer_rego_query_eval_ns_stddev |      37006 |
+-------------------------------------------+------------+

[garethahealy]

$ opa eval --bundle policy/ --input /tmp/rhcop/29-07-2020-21-07/policy/ocp/bestpractices/common-k8s-labels-notset/test_data/unit/list.yml --profile --format=pretty "data.ocp.bestpractices.common_k8s_labels_notset"
{
  "violation": [
    "Deployment/nolabels: does not contain all the expected k8s labels in 'metadata.labels'. See: https://kubernetes.io/docs/concepts/overview/working-with-objects/common-labels"
  ]
}
+------------------------------+----------+
|            METRIC            |  VALUE   |
+------------------------------+----------+
| timer_rego_load_bundles_ns   | 18567551 |
| timer_rego_module_compile_ns | 27352946 |
| timer_rego_module_parse_ns   | 4080646  |
| timer_rego_query_compile_ns  | 83375    |
| timer_rego_query_eval_ns     | 12196921 |
| timer_rego_query_parse_ns    | 12819    |
+------------------------------+----------+
+------------+----------+----------+---------------------------------------------------------------+
|    TIME    | NUM EVAL | NUM REDO |                           LOCATION                            |
+------------+----------+----------+---------------------------------------------------------------+
| 7.650367ms | 1        | 1        | policy/lib/openshift.rego:32                                  |
| 1.792691ms | 2        | 2        | policy/lib/konstraint.rego:29                                 |
| 1.020513ms | 1        | 1        | policy/ocp/bestpractices/common-k8s-labels-notset/src.rego:13 |
| 694.166µs  | 3        | 2        | policy/lib/openshift.rego:6                                   |
| 367.984µs  | 3        | 1        | policy/ocp/bestpractices/common-k8s-labels-notset/src.rego:16 |
| 319.135µs  | 1        | 1        | policy/lib/konstraint.rego:3                                  |
| 56.242µs   | 1        | 1        | data.ocp.bestpractices.common_k8s_labels_notset               |
| 34.72µs    | 5        | 5        | policy/ocp/bestpractices/common-k8s-labels-notset/src.rego:18 |
| 29.373µs   | 3        | 2        | policy/lib/konstraint.rego:48                                 |
| 29.359µs   | 3        | 2        | policy/lib/openshift.rego:11                                  |
+------------+----------+----------+---------------------------------------------------------------+