regalloc-evict-v1.1

This release contains a new regalloc eviction model trained using a new trace-based cost modeling technique. We see 0.5% performance improvements on some production workloads with some microbenchmarks seeing improvements up to 7%. We plan on open sourcing the trace-based cost modeling tooling soon. On the ML side, the model was trained with the upstream ES code modified slightly to work with the new cost modeling methodology.

regalloc-evict-v1.0

This release is a reference register allocation eviction model. We trained it on a FDO + ThinLTO corpus of a datacenter application, giving us 0.6% ~ 1.1% qps wins on a few internal datacenter applications.

inlining-Oz-v1.1

This release changes two things about the model:

1. The training corpus: instead of training on the modules from a single build target, we trained on roughly half of all C++ modules in the google monorepo. The "half" qualifier is due to training time, we trained this model for over 3 days on nearly a thousand (virtual) machines, and training on all of the monorepo would at least double the required compute.

2. The training method: instead of PPO, we used ES [*] (which is unfortunately not currently open sourced). This does not change the format of the saved model, but we found that this training method was easier to scale to accommodate the larger corpus.

We have found that this model is significantly more generalizable than previous model releases. If you try the model on your own internal build targets, let us know how it does!

[*] Krzysztof Choromanski, Mark Rowland, Vikas Sindhwani, Richard E. Turner, Adrian Weller: "Structured Evolution with Compact Architectures for Scalable Policy Optimization", https://arxiv.org/abs/1804.02395

inlining-Oz-v1.0

This model release incorporates two changes:

1. adding the "expanded cost" features, and
2. adding an additional hidden layer to accommodate the features.

This is a breaking change with previous releases of ml-compiler-opt.

inlining-Oz-v0.1

This is the base -Oz inlining model.