Code

V3#17

Code

Merged

jvansanten merged 101 commits intomainAmpelAstro/Ampel-ZTF-archive:mainfrom v3AmpelAstro/Ampel-ZTF-archive:v3Copy head branch name to clipboardJun 13, 2024

+7,176-1,096

Commits

Commits on Nov 18, 2021

• feat: preliminary support for S3 cutout storage

  Show description for 042c1e5
  jvansanten

  committed
  042c1e5

• fix: add cutout schema

  jvansanten

  committed
  98583d2

• fix: remove stray annotation

  jvansanten

  committed
  2b28127

Commits on Nov 22, 2021

• Deserialize avro as dependency

  jvansanten

  committed
  f2d60a3

Commits on Nov 23, 2021

• Store chunks of alerts in s3

  Show description for a36fc41
  jvansanten

  committed
  a36fc41

Commits on Jan 19, 2022

• Index read queue

  jvansanten

  committed
  ce6f8be

• Refactor healpix search to use generated column

  Show description for 709c536
  jvansanten

  committed
  709c536

• Merge branch 's3' into healpix-map-query

  jvansanten

  committed
  8517d4c

• ci: run localstack in service container

  jvansanten

  committed
  cfb33be

• Bump version to v3

  jvansanten

  committed
  4d674ac

• ci: run integration tests

  jvansanten

  committed
  02ba4cd

• deps: add fastavro

  jvansanten

  committed
  166481b

Commits on Jan 20, 2022

• Ensure archive_uri is unique

  jvansanten

  committed
  c5b51f4

Commits on Jan 21, 2022

• Do not attempt to store cutouts in the db

  jvansanten

  committed
  9cd89ed

Commits on Jan 22, 2022

• Make archive segment uri unique

  jvansanten

  committed
  45c60a6

• Update queue access time on chunk fetch

  jvansanten

  committed
  271ab86

Commits on Feb 14, 2022

• Accept alerts with empty history

  jvansanten

  committed
  67f7af9

Commits on Feb 16, 2022

• Isolate single alert inserts only

  Show description for 10e5718
  jvansanten

  committed
  10e5718

• deps: add coverage with explicit toml extra

  jvansanten

  committed
  883be3c

• Restore upsert for avro_archive

  jvansanten

  committed
  a99fa5b

• Remove with_cutouts argument everywhere

  Show description for 182708e
  jvansanten

  committed
  182708e

• Use postgres 14.1 in persistent service script

  jvansanten

  committed
  147b278

• Remove unsecured single-alert cutout post endpoint

  jvansanten

  committed
  27d318b

• Use same schema for single alerts and cutouts

  jvansanten

  committed
  a496f0c

• Remove duplicate AlertCutouts

  jvansanten

  committed
  b5c7bd7

• Restrict programid based on token

  Show description for 366591b
  jvansanten

  committed
  366591b

Commits on Feb 18, 2022

• Add candidate filters to search endpoints

  Show description for 6a5b55b
  jvansanten

  committed
  6a5b55b

• Make stream creation asynchronous

  Show description for 60f5d35
  jvansanten

  committed
  60f5d35

• Allow multiple conditions per field

  jvansanten

  committed
  6780447

• Expose pending and error states of queues

  jvansanten

  committed
  5f0d432

• Add query examples

  jvansanten

  committed
  e18a336

• Check stream status before returning a chunk

  jvansanten

  committed
  ab6ff1b

• Apply group API updates to /streams/from_topic

  jvansanten

  committed
  cb35387

• Use getitem for RowProxy

  Show description for ae66732
  jvansanten

  committed
  ae66732

• tests: await async stream creation

  jvansanten

  committed
  3d69750

• tests: remove parallel read test

  Show description for b93eb3b
  jvansanten

  committed
  b93eb3b

• chore: lockfile maintenance

  jvansanten

  committed
  8e43271

• deps: update fastapi to 0.74

  jvansanten

  committed
  34e1aae

• Return 202 from /streams/from_query

  Show description for 32161b7
  jvansanten

  committed
  32161b7

• Add custom error responses for stream

  jvansanten

  committed
  11c4a14

• Add chunk_size, error cols to read_queue_groups

  jvansanten

  committed
  3366aa0

• tests: follow status change on streams/from_query

  jvansanten

  committed
  1fa8d06

• Remove stray reference to cutout table

  jvansanten

  committed
  514cdf4

• Raise 404 when alert not found

  jvansanten

  committed
  3929d6c

• Apply timeouts to each session separately

  Show description for 48f029c
  jvansanten

  committed
  48f029c

Commits on Mar 1, 2022

• Catch and report query timeouts as 504

  Show description for de9f715
  jvansanten

  committed
  de9f715

Commits on Mar 2, 2022

• Use $-prefixed ops for time constraint

  Show description for 3d96fab
  jvansanten

  committed
  3d96fab

• Store query exception in group table

  jvansanten

  committed
  4076eef

• Ignore missing psycopg2 stubs

  jvansanten

  committed
  e99d5b3

• Use $-prefixed ops in examples

  jvansanten

  committed
  bc6b14d

• Follow 3d96fab through tests

  jvansanten

  committed
  dcdd3aa

• Make chunk reads stateful

  Show description for eb81fbe
  jvansanten

  committed
  eb81fbe

• Disable cron for tests

  jvansanten

  committed
  c7f7761

Commits on Mar 29, 2022

• fix: clip stray print

  jvansanten

  committed
  9e73b87

• fix: return alerts from get_alerts_for_object

  jvansanten

  committed
  e04246f

Commits on Jul 15, 2022

• V3: Add stream query for objectIds (#10)

  Show description for 90cf481
  simeonreusch

  authored
  90cf481

Commits on Oct 19, 2022

• Enable pagination on objectId/alerts

  jvansanten

  committed
  c8bd776

Commits on Jan 4, 2023

• Reimplement cone search in terms of healpix

  jvansanten

  committed
  bea934f

• Explicitly cast pixel idx to int

  jvansanten

  committed
  5d844f7

Commits on Jan 10, 2023

• deps: pin fastavro to <1.7

  jvansanten

  committed
  489a64c

Commits on Jan 18, 2023

• Add optional query debug

  jvansanten

  committed
  b319de2

• Unroll pixel ranges

  jvansanten

  committed
  111a23a

Commits on Jan 25, 2023

• Order cone-search rows by candidate.jd

  Show description for 4c3a42a
  jvansanten

  committed
  4c3a42a

Commits on Feb 17, 2023

• Bump version

  jvansanten

  committed
  17a01b1

• move mypy config into pyproject.toml

  jvansanten

  committed
  1fabb7d

• Make upper limits optional in photopoint query (#12)

  Show description for bb9a98d
  jvansanten

  authored
  bb9a98d

• Use nside 65535 for healpix queries

  jvansanten

  committed
  d1e65c1

• Set healpix index on insert

  jvansanten

  committed
  3f1494e

Commits on Feb 20, 2023

• Explicitly cast pixel indices to int

  jvansanten

  committed
  8ebe2a8

• Add migration script

  jvansanten

  committed
  64e293b

• use row-level locks for migration

  jvansanten

  committed
  fb77053

Commits on Feb 22, 2023

• Add indexes with correct names

  jvansanten

  committed
  9b5875a

Commits on Apr 5, 2023

• Support resume_token in get_alerts_in_healpix_map

  jvansanten

  committed
  ad01039

Commits on Apr 17, 2023

• Support region query in alerts/healpix/skymap

  jvansanten

  committed
  7f2dc54

Commits on Apr 21, 2023

• Use ordered updates in table compactification

  Show description for d7654b1
  jvansanten

  committed
  d7654b1

Commits on May 9, 2023

• Use candidate filter in /alerts/healpix/skymap

  jvansanten

  committed
  37f6425

• working healpix migration

  jvansanten

  committed
  0b6478a

Commits on Aug 21, 2023

• Add query for alert count that does not return alerts

  jvansanten

  committed
  04c6870

• Add response model

  jvansanten

  committed
  b5a9286

• Return actual column

  jvansanten

  committed
  36eaa46

Commits on Aug 22, 2023

• Validate nside early

  jvansanten

  committed
  eea96b3

Commits on Oct 18, 2023

• Retrieve alerts with schema 4.02

  jvansanten

  committed
  cc717bf

Commits on Oct 23, 2023

• ArchiveDB: explicitly set schema for photopoints

  jvansanten

  committed
  f3eb4cb

Commits on Nov 6, 2023

• Support all schema versions found in the wild

  jvansanten

  committed
  a75a64a

Commits on Feb 12, 2024

• Delete alert chunk on exception

  jvansanten

  committed
  5d0695d

Commits on Feb 20, 2024

• Recover number of alerts in payload from s3

  jvansanten

  committed
  f2560f9

• Fill count field on archive insert

  jvansanten

  committed
  13e6c16

• Add reference count for blobs

  jvansanten

  committed
  5bd706d

• Clean up orphaned blobs

  jvansanten

  committed
  f062249

Commits on Apr 15, 2024

• Add alert sample endpoint

  jvansanten

  committed
  12258f2

• Handle schema 1.9

  jvansanten

  committed
  fc44129

Commits on May 2, 2024

• Remove auth in get_cutouts

  Show description for b804887
  jvansanten

  committed
  b804887

Commits on Jun 11, 2024

• Split background stream creation into two parts

  Show description for 969eb40
  jvansanten

  committed
  969eb40

• mypy cleanup

  jvansanten

  committed
  c9980a6

Commits on Jun 12, 2024

• ci: prefer port over uri

  jvansanten

  committed
  617b657

• Merge remote-tracking branch 'origin/main' into v3

  jvansanten

  committed
  edcd186

• mypy: set default package

  jvansanten

  committed
  659d4d1

• pytest: set ini options

  jvansanten

  committed
  662524e

• shiny for mypy

  jvansanten

  committed
  2e5c0e9

Commits on Jun 13, 2024

• initdb: missing line terminator

  jvansanten

  committed
  91f3a29

• tests: run integration tests by default

  jvansanten

  committed
  11cf17e