fast import: allow restore to provided connection string

[NanoBjorn]

Within https://github.com/neondatabase/cloud/issues/22089 we decided that would be nice to start with import that runs dump-restore into a running compute (more on this here) We could do it by writing another tool or by extending existing fast_import.rs, we chose the latter.

In this PR, I have added optional restore_connection_string as a cli arg and as a part of the json spec. If specified, the script will not run postgres and will just perform restore into provided connection string.

TODO:

• fast_import.rs:
  • cli arg in the fast_import.rs
  • encoded connstring in json spec
  • simplify fn main a little, take out too verbose stuff to some functions
  • allow streaming from dump stdout to restore stdin will do in a separate PR
  • address fast import: restore to neondb (not postgres) database #10251 (review) will do in a separate PR
• tests:
  • restore with cli arg in the fast_import.rs
  • restore with encoded connstring in json spec in s3
  • test with custom dbname will do in a separate PR
  • test with s3 + pageserver + fast import binary will do in a separate PR
  • fast import: basic python test #10271 (comment) will do in a separate PR

neondatabase/cloud#22775

[github-actions]

7359 tests run: 6981 passed, 1 failed, 377 skipped (full report)

---

Failures on Postgres 17

• test_scrubber_tenant_snapshot[4]: debug-x86-64

# Run all failed tests locally:
scripts/pytest -vv -n $(nproc) -k "test_scrubber_tenant_snapshot[debug-pg17-4]"

Test coverage report is not available

_{The comment gets automatically updated with the latest test results
b79e5f5 at 2025-01-21T17:33:24.690Z :recycle:}

[duskpoet]

why not put the restore connection string into the spec? Shouldn't it be encoded the same way as the source string?

[NanoBjorn]

why not put the restore connection string into the spec? Shouldn't it be encoded the same way as the source string?

I have done it both ways as with source connection strings, there are tests on both paths as well