Added
- Optionally set
ALLOWED_DOMAINS
environment variable for CORS
v6.2.0 - 2023-05-10
See [v6.2.0] changes
Added
- The list datasets endpoint now provides the Last Updated Datetime for each dataset
v6.0.2 - 2023-03-24
See v6.0.2 changes
Fixed
- Fixed a bug concerning dataset uploading with overwrite behaviour, making it much less brittle.
v5.0.2 - 2023-03-09
See v5.0.2 changes
Fixed
- Fetching datasets for the UI was only returning write access
v5.0.0 - 2022-01-27
See v5.0.0 changes
v5.0.0 is a major release of rAPId with several breaking changes. One of the major changes is the splitting out of the user interface into it's own codebase. It also introduces a data catalog metadata search.
Added
- New description field for dataset schemas. This is a human readable tag that can be applied to datasets so a user can understand the datasets functionaility.
- Dataset metadata search endpoint
/api/datasets/search/{search term}
Changed
- Test users are created automatically within the infrastructure now and are prefixed accordingly
- (Breaking Change) All api routes are now served on the prefix
/api
. For instance the api route to list datasetsGET /datasets
now becomesGET /api/datasets
- (Breaking Change) The storage of the pretty printed JSON schemas has been removed to allow for them be queriable within Athena. This is requied for the data catalog search. To migrate over it is required to run the migration
migrations/scripts/v5_schema_migration.py
. - Test users are now prefixed as they are generated within the infrastructure.
Removed
- The simple static user interface hosted within the API has been removed and is now hosted as it's own (service)[https://github.com/no10ds/rapid-ui]
v4.1.2 - 2022-11-29
v4.1.2 Fix for query large dataset client usage
Fixes
- Fix query large dataset client usage
v4.1.0 - 2022-11-20
v4.1.0 introduces a new UI for the easy creation of schemas and the ability to expose the rAPId instance to the Gov UK CDDO Federated API Discovery Model (https://github.com/co-cddo/federated-api-model). Instead of having to use the rAPId endpoints to generate and then upload the schema, the new UI opens a simple flow from uploading a file, to altering the generated schema and to then uploading.
Added
- UI
- Schema creation flow
- CDDO Federated API Discovery
v3.0.0 - 2022-08-26
See v3.0.0 changes
v3.0.0 Provides download functionality in the UI, allowing the user to query. Also, it introduces parquet as the format
to store files, allowing then null values in the datasets.
Fixed
- Error when querying files with null values on numeric columns.
- Add protected domains to list all datasets endpoint.
Added
- UI
- Input validation on subject creation
- Data management download flow
- Allow user to download datasets from the UI
- Allow user to introduce queries
Changed
- Store files in parquet instead of csv
- Data management migrated to parquet
v1.3.0 - 2022-06-17
See v1.3.0 changes
Added
- Getting started documentation to walkthrough dataset uploading and querying
Fixed
- Add
resource_prefix
to the necessary AWS resources to enable the hosting of multiple rAPId instances
v1.1.0 - 2022-05-29
See v1.1.0 changes