Skip to content

Releases: nbbrd/sdmx-dl

Release v3.0.0-beta.13

06 Sep 13:35
Compare
Choose a tag to compare

3.0.0-beta.13 - 2024-09-06

This is the thirteenth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release improves the modularity of the API and continues to clean up the configuration.
The experimental PxWebDriver has also been improved but is not yet ready for daily use.
The OECD, INEGI and ILO endpoints have been updated.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in
production!

Added

  • API Move FileFormat and Persistence to API
  • API Add registry API to load custom web sources
  • PROVIDER Add support of databases in PxWebDriver
  • PROVIDER Add parsing of language in PxWebDriver
  • PROVIDER Add websites in PxWebDriver
  • DESKTOP Improve desktop UI
  • GRPC Add webservice transcoding in gRPC

Changed

  • API Force use of screaming-snake-case pattern on driver ID
  • PROVIDER Rename source-file property from sdmxdl.sources to sdmxdl.registry.sourcesFile
  • PROVIDER Rename user-agent property from http.agent to sdmxdl.driver.userAgent
  • PROVIDER Rename dump-folder property from sdmxdl.ri.web.dump.folder to sdmxdl.driver.dumpFolder
  • PROVIDER Replace curl-backend property sdmxdl.networking.curlBackend with url-backend property sdmxdl.networking.urlBackend
  • CLI Replace list drivers command with list plugins command

Fixed

  • SOURCE Update OECD source #543
  • SOURCE Update INEGI source #639
  • SOURCE Update ILO source #690

Release v3.0.0-beta.12

16 Oct 13:29
Compare
Choose a tag to compare

3.0.0-beta.12 - 2023-10-16

This is the twelfth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release brings a more flexible configuration system: cache, network and language can be specified by source if
needed and environment variables are used as default values.
The API has been refactored to make it both simpler and more flexible.
The ECB endpoint has also been updated.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in
production!

Added

  • API Add support of partial ISO date/time in TimeInterval
  • PROVIDER Allow caching & networking configuration by environment
    variables #516
  • PROVIDER Allow caching & networking configuration per source #493

Fixed

  • PROVIDER Fix file locking in cache

Changed

  • API Refactor cache API #500
  • API Refactor network API #503
  • API Remove dialect API #505
  • API Refactor listeners API #506
  • API Handle languages per connection instead of per manager #507
  • API Simplify naming and structure #508
  • API Change pattern of drivers properties
  • API Improve support of ISO-8601 duration
  • SOURCE Update ECB endpoint #495
  • FORMAT Refactor file format API #502
  • PROVIDER Move curl backend to an external project
  • PROVIDER Move PxWebDriver to its own module
  • PROVIDER Move dialects drivers to their own module
  • CLI Use environment variables as default values
  • GRPC Migrate gRPC module to Quarkus framework

Release v3.0.0-beta.11

02 Jun 09:05
Compare
Choose a tag to compare

3.0.0-beta.11 - 2023-06-02

This is the eleventh beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release adds new sources from Eurostat and the European Commission.
It also improves performance of several drivers alongside the usual bug fixes.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in
production!

Added

  • API Add feature descriptor DATA_QUERY_ALL_KEYWORD
  • SOURCE Add sources from Directorates General of the European
    Commission #414
  • SOURCE Add source from Eurostat International trade in goods #415

Fixed

  • PROVIDER Fix URL squashing in curl backend #417
  • PROVIDER Fix cache when two sources share the same host #413

Changed

  • API Improve request for available key codes
  • SOURCE Improve source from Economic and Social Commission for Asia and the
    Pacific #418
  • FORMAT Use protobuf as default cache format
  • PROVIDER Improve Eurostat driver #416
  • PROVIDER Add support of DATA_QUERY_ALL_KEYWORD feature in RI
  • PROVIDER Replace error by empty stream when no data is available

Removed

  • API Remove feature descriptor DATA_QUERY_KEY

Release v3.0.0-beta.10

13 Feb 13:11
Compare
Choose a tag to compare

3.0.0-beta.10 - 2023-02-13

This is a bugfix release for the deployment of v3.0.0-beta.9.
See v3.0.0-beta.9 for complete changelog.

Fixed

  • Fix missing javadoc resource

3.0.0-beta.9 - 2023-02-13

This is the ninth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release brings the API closer to the SDMX standard. It fixes an important problem with Eurostat. It also adds two
proof of concept for future use.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in
production!

Added

  • API Add support of time intervals in observations #394
  • PROVIDER Add support of redirections in curl backend #363
  • DESKTOP Add desktop application proof of concept #401
  • GRPC Add gRPC service proof of concept #402

Changed

  • API Sort observations chronologically #396
  • API Enforce non-null observations fields #396
  • API Invert fields in DataDetail #396
  • API Set default values to DataQuery #396
  • API Rename field Dimension#label as Dimension#name #395
  • API Rename field Attribute#label as Attribute#name #395
  • API Rename field DataStructure#label as DataStructure#name #395
  • API Rename field SdmxWebSource#name as SdmxWebSource#id #395
  • API Rename field SdmxWebSource#description as SdmxWebSource#name #395
  • API Set field Dataflow#description as optional #395
  • API Set field Obs#getPeriod as TimeInterval #394
  • FORMAT Improve parsing of time formats #394
  • FORMAT Rename module sdmx-dl-format-util as smdx-dl-format-base
  • FORMAT Rename module sdmx-dl-provider-util as smdx-dl-provider-base

Fixed

  • FORMAT Fix language consistency in names and descriptions #397
  • PROVIDER Fix Eurostat endpoint #346

Release v3.0.0-beta.8

22 Nov 12:00
Compare
Choose a tag to compare

3.0.0-beta.8 - 2022-11-22

This is the eighth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release brings support of description in data flows. It also updates a few sources alongside the usual bugfixes.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in
production!

Added

  • API Add field Dataflow#description #287
  • SOURCE Add source from UN International Children's Emergency Fund #95

Changed

  • API Improve code coherence by replacing Dataflow#of(...) and DataQuery#of(...) with builders
  • API Rename field Dataflow#label as Dataflow#name
  • API Move SdmxCubeUtil from provider util to API
  • SOURCE Modify ISTAT endpoint #339
  • CLI Modify list/flows command headers to follow Dataflow changes
  • DOC Enforce https in doc URL

Fixed

  • BUILD Fix dependency inheritance in BOM

Release v3.0.0-beta.7

10 Aug 12:03
Compare
Choose a tag to compare

3.0.0-beta.7 - 2022-08-10

This is the seventh beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release reshapes CLI commands, simplifies the network configuration and improves startup time.
It introduces a new dedicated documentation to replace the wiki.
It finalizes the support of SDMX time formats and attribute relationship in the API.
A new source is also added alongside the usual bugfixes.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in production!

Added

  • API Add URL connection factory in Network
  • API Add SdmxWebSource#monitorWebsite field
  • API Add SdmxWebSource#getDescription(LanguagePriorityList) method
  • API Add support of attribute relationship #81
  • SOURCE Add source from National Statistical Office of Thailand #262
  • FORMAT Add support of time range in time formats
  • PROVIDER Add support of POST requests in HTTP backend
  • PROVIDER Add driver for International Monetary Fund source #156
  • CLI Add list/availability command
  • CLI Add MonitorWebsite column in list/sources command
  • CLI Add Languages column in list/sources command #266

Changed

  • PROVIDER Improve error reporting on content-type in HTTP response header
  • CLI Use option instead of property to enable curl backend
  • CLI Remove cache folder option
  • CLI Replace position column with index column in list/concepts command
  • CLI Split command list/concepts into list/dimensions and list/attributes
  • CLI Improve startup time when using custom sources
  • CLI Remove sdmx-dl-provider-connectors dependency
  • CLI Remove custom name of shaded binary
  • DOC Migrate documentation to GitHub Pages #268

Fixed

  • PROVIDER Fix uptime parsing on multi-thread environment
  • PROVIDER Fix parsing of HTTP response header in curl backend
  • PROVIDER Fix NPE on missing HTTP response message
  • PROVIDER Fix DataflowRef validation
  • PROVIDER Fix Statistics Canada revisions #252
  • CLI Fix missing charsets in native image
  • CLI Fix registration of system SSL in native image
  • CLI Fix usage of dependency-reduced pom

Release v3.0.0-beta.6

21 Apr 08:38
Compare
Choose a tag to compare

3.0.0-beta.6 - 2022-04-21

This is the sixth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

This release focuses on API refactoring to allow future improvements.
It introduces a mechanism that validates the input parameters to give a better feedback in case of error.
A few sources are also added.

Disclaimer: sdmx-dl is still in development and is available for test only. Do not use in production!

Added

  • API Add parameters validity check #138
  • API Add multi-language descriptions in SdmxWebSource #203
  • SOURCE Add source from El Salvador Labour Market Information System #202
  • SOURCE Add source from Statistics Luxembourg #245
  • BUILD Add Maven BOM

Changed

  • API Refactor data queries #218
  • API Refactor features discovery #89
  • API Simplify class hierarchy #222
  • API Simplify class naming scheme #220
  • API Refactor dialects handling #227
  • API Simplify module names
  • API Refactor format and provider utilities
  • SOURCE Enforce https on ISTAT source
  • PROVIDER Change FileDriver to be optional

Fixed

  • FORMAT Fix missing series header in compact data #172
  • PROVIDER Fix input validation in Statistics Canada driver #171
  • PROVIDER Fix curl certificate revocation checks on missing/offline check lists
  • CLI Fix Java package requirement in Homebrew distribution #206
  • CLI Fix use of reflection in native image
  • CLI Fix missing resources in native image

Release v3.0.0-beta.5

23 Nov 13:51
Compare
Choose a tag to compare

3.0.0-beta.5 - 2021-11-23

This is the fifth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

Note that sdmx-dl is still in heavy development and might change a lot between versions, so you shouldn't use it in
production.

This release adds the support of most SDMX time formats.
The execution time of CLI is reduced greatly by using a smarter cache and by avoiding to load unnecessary resources.
A few sources are also added, including a random data generator that can be used for tests/demos.

Added

  • Add support of codelist in API #158
  • Add native driver for INSEE #157
  • Add native driver for Eurostat #155
  • Add second layer of cache in CLI
  • Add availability check on driver SPI #162
  • Add optional RNG driver #163
  • Add cache-folder-path option in CLI
  • Add source from Statistics Canada #165
  • Add support of non-calendar reporting periods

Changed

  • Refactor network API to avoid unnecessary resource loading
  • Invert default activation of auto-proxy option in CLI
  • Simplify name of auto-proxy option in CLI
  • Replace multiple parameters with DataRef in API
  • Change SdmxWebSource#endpoint type to URI
  • Change SdmxWebSource#monitor type to URI
  • Change cache default folder to java.io.tmpdir/sdmx-dl/VERSION
  • Refactor parsing of SDMX time formats

Fixed

  • Improve error reporting in CLI
  • Restore setup-completion command
  • Fix setup commands names
  • Fix datetime parsing of undefined freq
  • Fix dimension ordering when used in key
  • Fix external references in flows
  • Migrate ABS source to the new server #168

Release v3.0.0-beta.4

21 Oct 14:25
Compare
Choose a tag to compare

3.0.0-beta.4 - 2021-10-21

This is the fourth beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

Note that sdmx-dl is still in heavy development and might change a lot between versions, so you shouldn't use it in production.

This release simplifies the CLI options and fixes web monitors by using a new self-hosted provider.
The CLI binary is now also available in a JBang catalog and in a snapshot repository.

Added

  • Add a link to documentation in CLI #137
  • Add support of average response time in monitors #144
  • Add Maven deployment of CLI
  • Add distribution to JBang #141

Changed

  • Rename command check.properties as check.config #136
  • Migrate web monitors to Upptime #142
  • Refactor cache to handle web monitors
  • Simplify CSV command options #88

Fixed

  • Fix missing content in subsequent calls to fetch-meta command #154
  • Fix detection of console encoding

Release v3.0.0-beta.3

13 Sep 14:03
Compare
Choose a tag to compare

3.0.0-beta.3 - 2021-09-13

This is the third beta release of sdmx-dl.
sdmx-dl follows semantic versioning.

Note that sdmx-dl is still in heavy development and might change a lot between versions so you shouldn't use it in production.

This release adds new sources and improves feedback on request parameters such as Key and Flow.
The CLI binary is now available in some popular package managers.
Finally, sdmx-dl advertises itself on web queries with the user-agent sdmx-dl/3.0.0-beta.3.

Added

  • Add support of multiple media-types in HTTP request header (RI)
  • Add support of media-type charset in HTTP response header (RI)
  • Add response event #onSuccess(MediaType) (RI)
  • Add default user-agent sdmx-dl/version (RI) #117
  • Add source from Bundesbank #104
  • Add source from Economic and Social Commission for Asia and the Pacific #99
  • Add source from National Statistical Institute of Cambodia #98
  • Add source from SDMX Global Registry #97
  • Add source from Pacific Data Hub #96
  • Add source from UK Data Service #93
  • Add distribution to Scoop (Windows) #83
  • Add distribution to Homebrew (macOS & Linux) #84

Changed

  • Enforce https on ABS source #108
  • Improve CLI version option #79
  • Refactor SdmxWebAuthenticator as an SPI
  • Improve feedback on missing data flow #123

Fixed

  • Fix parsing of blank labels
  • Update ILO source with new endpoint #107
  • Fix key parsing when time dimension is not last in data structure #110
  • Fix key validity check on input #118
  • Fix parsing of media types in SDMX21 driver