Add tracking of memory usage

[EricLBuehler]

This will implement memory usage tracking. This will be used for #377.

• CPU
• CUDA: https://docs.rs/cudarc/latest/cudarc/driver/result/fn.mem_get_info.html
• Metal

[github-actions]

Code Metrics Report

  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 Dockerfile              1           34           25            0            9
 Happy                   1          442          369            0           73
 JSON                   10           66           65            0            1
 Python                 36         1412         1220           38          154
 TOML                   18          518          458           11           49
-------------------------------------------------------------------------------
 Jupyter Notebooks       1            0            0            0            0
 |- Markdown             1           60           30           22            8
 |- Python               1           96           87            1            8
 (Total)                            156          117           23           16
-------------------------------------------------------------------------------
 Markdown               21         1554            0         1173          381
 |- BASH                 5          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               5           98           88            0           10
 |- Rust                 4          221          198           10           13
 |- TOML                 2           75           63            0           12
 (Total)                           2061          459         1183          419
-------------------------------------------------------------------------------
 Rust                  131        44177        40056          775         3346
 |- Markdown            77          723           13          671           39
 (Total)                          44900        40069         1446         3385
===============================================================================
 Total                 220        48203        42193         1997         4013
===============================================================================