Ubuntu 22.04 does not support RSA keys by default any longer. Upgrade to ed25519.

Ubuntu 22.04 disabled support for RSA keys because they have been deemed far
too insecure and other key types are fully supported.

To ssh into Ubuntu 22.04 images, it is recommended to use an ed25519 key for
enhanced security not only for Ubuntu 22.04 but for all operating systems.