Skip to content

v5.0.0
Compare
Choose a tag to compare
@TobyDrane TobyDrane released this 01 Feb 21:59
· 105 commits to main since this release
v5.0.0
d68d4ce

v5.0.0 is a major release of rAPId with several breaking changes. One of the major changes is the splitting out of the user interface into it's own codebase. It also introduces a data catalog metadata search.

Added

  • New description field for dataset schemas. This is a human readable tag that can be applied to datasets so a user can understand the datasets functionaility.
  • Dataset metadata search endpoint /api/datasets/search/{search term}

Changed

  • Test users are created automatically within the infrastructure now and are prefixed accordingly
  • (Breaking Change) All api routes are now served on the prefix /api. For instance the api route to list datasets GET /datasets now becomes GET /api/datasets
  • (Breaking Change) The storage of the pretty printed JSON schemas has been removed to allow for them be queriable within Athena. This is requied for the data catalog search. To migrate over it is required to run the migration migrations/scripts/v5_schema_migration.py.
  • Test users are now prefixed as they are generated within the infrastructure.

Removed

  • The simple static user interface hosted within the API has been removed and is now hosted as it's own (service)[https://github.com/no10ds/rapid-ui]

v4.1.2 - 2022-11-29

v4.1.2 Fix for query large dataset client usage

Fixes

  • Fix query large dataset client usage

v4.1.0 - 2022-11-20

v4.1.0 introduces a new UI for the easy creation of schemas and the ability to expose the rAPId instance to the Gov UK CDDO Federated API Discovery Model (https://github.com/co-cddo/federated-api-model). Instead of having to use the rAPId endpoints to generate and then upload the schema, the new UI opens a simple flow from uploading a file, to altering the generated schema and to then uploading.

Added

  • UI
    • Schema creation flow
  • CDDO Federated API Discovery

v3.0.0 - 2022-08-26

See v3.0.0 changes

v3.0.0 Provides download functionality in the UI, allowing the user to query. Also, it introduces parquet as the format
to store files, allowing then null values in the datasets.

Fixed

  • Error when querying files with null values on numeric columns.
  • Add protected domains to list all datasets endpoint.

Added

  • UI
    • Input validation on subject creation
    • Data management download flow
      • Allow user to download datasets from the UI
      • Allow user to introduce queries

Changed

  • Store files in parquet instead of csv
  • Data management migrated to parquet

v1.3.0 - 2022-06-17

See v1.3.0 changes

Added

  • Getting started documentation to walkthrough dataset uploading and querying

Fixed

  • Add resource_prefix to the necessary AWS resources to enable the hosting of multiple rAPId instances

v1.1.0 - 2022-05-29

See v1.1.0 changes

Added

  • Protected domains:
    • Allows the separation of access permissions for specific protected domains
    • See the data acccess docs
    • See usage docs
  • Overwrite update behaviour:
    • Allows datasets to be overwritten when a new file is uploaded, rather than just appended to
    • See the schema creation docs
Assets 2
Loading