Create ext_index.json

[awestover]

Problem

compute_ctl expects needs a file ext_index.json containing the data necessary to create control files, and containing the locations of extension archives in remote storage.
The ext_index.json file should be generated by Dockerfile.compute-node.

Summary of Changes

The layout of the S3 bucket is as follows:

5615610098 // this is an extension build number
├── v14
│   ├── extensions
│   │   ├── anon.tar.zstd
│   │   └── embedding.tar.zstd
│   └── ext_index.json
└── v15
    ├── extensions
    │   ├── anon.tar.zstd
    │   └── embedding.tar.zstd
    └── ext_index.json
5615261079
├── v14
│   ├── extensions
│   │   └── anon.tar.zstd
│   └── ext_index.json
└── v15
    ├── extensions
    │   └── anon.tar.zstd
    └── ext_index.json
5623261088
├── v14
│   ├── extensions
│   │   └── embedding.tar.zstd
│   └── ext_index.json
└── v15
    ├── extensions
    │   └── embedding.tar.zstd
    └── ext_index.json

ext_index.json stores the control files and location of extension archives.

More specifically, here is an example ext_index.json

{
  "embedding": {
    "control_data": {
      "embedding.control": "comment = 'hnsw index' \ndefault_version = '0.1.0' \nmodule_pathname = '$libdir/embedding' \nrelocatable = true \ntrusted = true"
    },
    "archive_path": "5623261088/v15/extensions/embedding.tar.zstd"
  },
  "anon": {
    "control_data": {
      "anon.control": "# PostgreSQL Anonymizer (anon) extension \ncomment = 'Data anonymization tools' \ndefault_version = '1.1.0' \ndirectory='extension/anon' \nrelocatable = false \nrequires = 'pgcrypto' \nsuperuser = false \nmodule_pathname = '$libdir/anon' \ntrusted = true \n"
    },
    "archive_path": "5615261079/v15/extensions/anon.tar.zstd"
  }
}

[github-actions]

1040 tests run: 987 passed, 1 failed, 52 skipped (full report)

---

Failures on Posgres 14

• test_crafted_wal_end[last_wal_record_xlog_switch_ends_on_page_boundary]: debug

# Run all failed tests locally:
scripts/pytest -vv -n $(nproc) -k "test_crafted_wal_end[debug-pg14-last_wal_record_xlog_switch_ends_on_page_boundary]"

Flaky tests (1)

Postgres 15

• test_crafted_wal_end[last_wal_record_crossing_segment]: debug

[awestover]

note: failure of 0c0f494 is just flaky tests, not an actual problem

[awestover]

DONT FORGET CHANGE THIS:

    # if: |
    #   (github.ref_name == 'main' || github.ref_name == 'release') &&
    #    github.event_name != 'workflow_dispatch'

[lubennikovaav]

closed in favor of #4792