Use more templates & interfaces in the codebase to ensure better code quality, easier refactoring etc.
Ie. SDR-type wrapping all data going between (and inside) layers (what is array[] now) will make it easier to switch to vector, CUDA sparse array, ...
Or a proper Serializable interface would allow to switch to/from capnp,...