storcon: make pageserver AZ id mandatory

[VladLazar]

Problem

#8852 introduced a new nullable column for the nodes table: availability_zone_id

Summary of changes

• Make neon local and the test suite always provide an az id
• Make the az id field in the ps registration request mandatory
• Migrate the column to non-nullable and adjust in memory state accordingly
• Remove the code that was used to populate the az id for pre-existing nodes

This should roll out one deployment after #8852
and we should validate that there are no null entries for the node.availability_zone_id column.

Note

This breaks the test_backward_compatibility test because the current release version of neon local
does not contain #8897. Hence, the migration to make the az id column not null fails.

In production we already have code that detects the az for pageservers and persists them upon registration.
I will merge this PR later into the week and check that all pageservers have persisted an az id.

Checklist before requesting a review

• I have performed a self-review of my code.
• If it is a core feature, I have added thorough tests.
• Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
• If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

• Do not forget to reformat commit message to not include the above checklist

[github-actions]

3822 tests run: 3712 passed, 0 failed, 110 skipped (full report)

---

Flaky tests (4)

Postgres 16

• test_peer_recovery: release-arm64

Postgres 15

• test_subscriber_restart: release-x86-64

Postgres 14

• test_scrubber_physical_gc[4]: release-x86-64
• test_subscriber_restart: release-x86-64

Code coverage* (full report)

• functions: 32.3% (7430 of 22979 functions)
• lines: 50.5% (60175 of 119052 lines)

* collected from Rust tests only

---

_{The comment gets automatically updated with the latest test results
e10a76f at 2024-09-04T13:25:39.267Z :recycle:}

[VladLazar]

Need to merge https://github.com/neondatabase/cloud/pull/17191 on the cplane side for e2e tests to pass first.

[VladLazar]

As of 2024-09-05 all nodes in all regions (apart from the azure region which I couldn't check) have AZs assigned.
I had to manually update a few because deployment was done in reverese order (ps first then storcon).