Skip to content

Releases: daq-tools/skeem

v0.1.1

22 Oct 07:37
Compare
Choose a tag to compare

What's Changed

  • Added support for Python 3.12 and 3.13
  • Adjusted SQL DDL for sqlalchemy-cratedb 0.40.0
  • Adjusted ddlgenerator wrapper for pandas 2
  • Updated to frictionless >=5.16

Details

  • Chore: Update dependencies and documentation, and satisfy linter by @amotl in #3
  • Bump docker/metadata-action from 4 to 5 by @dependabot in #4
  • Bump docker/setup-buildx-action from 2 to 3 by @dependabot in #5
  • Bump actions/checkout from 3 to 4 by @dependabot in #7
  • Bump docker/login-action from 2 to 3 by @dependabot in #8
  • Bump docker/build-push-action from 4 to 5 by @dependabot in #9
  • Update requests requirement from <2.30 to <2.32 by @dependabot in #6
  • Update types-requests requirement from <2.30 to <2.32 by @dependabot in #11
  • Update pyproject-fmt requirement from <1.2 to <1.3 by @dependabot in #14
  • Bump fsspec[gcs,github,http,s3] from 2023.1 to 2023.9.2 by @dependabot in #15
  • Bump ruff from 0.0.291 to 0.0.292 by @dependabot in #17
  • Update validate-pyproject requirement from <0.15 to <0.16 by @dependabot in #19
  • Bump mypy from 1.5.1 to 1.6.0 by @dependabot in #18
  • Bump ruff from 0.0.292 to 0.1.1 by @dependabot in #20
  • Bump fsspec[gcs,github,http,s3] from 2023.9.2 to 2023.10.0 by @dependabot in #21
  • Bump mypy from 1.6.0 to 1.6.1 by @dependabot in #22
  • Bump ruff from 0.1.1 to 0.1.3 by @dependabot in #23
  • Bump docker/setup-qemu-action from 2 to 3 by @dependabot in #24
  • Bump ruff from 0.1.3 to 0.1.4 by @dependabot in #25
  • Update pyproject-fmt requirement from <1.3 to <1.5 by @dependabot in #26
  • Update pyproject-fmt requirement from <1.5 to <1.6 by @dependabot in #27
  • Bump ruff from 0.1.4 to 0.1.6 by @dependabot in #29
  • Bump mypy from 1.6.1 to 1.7.0 by @dependabot in #30
  • Bump mypy from 1.7.0 to 1.7.1 by @dependabot in #31
  • Bump fsspec[gcs,github,http,s3] from 2023.10.0 to 2023.12.0 by @dependabot in #32
  • Bump ruff from 0.1.6 to 0.1.8 by @dependabot in #35
  • Bump ruff from 0.1.8 to 0.1.9 by @dependabot in #37
  • Bump actions/upload-artifact from 3 to 4 by @dependabot in #38
  • Bump actions/setup-python from 4 to 5 by @dependabot in #39
  • Bump fsspec[gcs,github,http,s3] from 2023.12.0 to 2023.12.2 by @dependabot in #36
  • Bump ruff from 0.1.9 to 0.1.11 by @dependabot in #40
  • Bump mypy from 1.7.1 to 1.8.0 by @dependabot in #41
  • Update pyproject-fmt requirement from <1.6 to <1.7 by @dependabot in #42
  • Bump ruff from 0.1.11 to 0.1.13 by @dependabot in #43
  • Update pyproject-fmt requirement from <1.7 to <1.8 by @dependabot in #44
  • Bump ruff from 0.1.13 to 0.1.14 by @dependabot in #45
  • Update xarray requirement from <2024 to <2025 by @dependabot in #48
  • Update pytest requirement from <8 to <9 by @dependabot in #51
  • Bump actions/cache from 3 to 4 by @dependabot in #50
  • Update validate-pyproject requirement from <0.16 to <0.17 by @dependabot in #52
  • Bump fsspec[gcs,github,http,s3] from 2023.12.2 to 2024.3.1 by @dependabot in #55
  • Update poethepoet requirement from <0.25 to <0.27 by @dependabot in #57
  • Regular maintenance 202405 by @amotl in #60
  • Update pyproject-fmt requirement from <1.9 to <2.2 by @dependabot in #64
  • Update pytest-cov requirement from <5 to <6 by @dependabot in #63
  • Update types-requests requirement from <2.32 to <2.33 by @dependabot in #66
  • Bump fsspec[gcs,github,http,s3] from 2024.3.1 to 2024.6.0 by @dependabot in #67
  • Dependencies: Migrate from crate[sqlalchemy] to sqlalchemy-cratedb by @amotl in #68
  • Dependencies: Use numpy<2 to resolve compatibility issues by @amotl in #72
  • Chore(deps): Update requests requirement from <2.32 to <2.33 by @dependabot in #70
  • Chore(deps): Bump docker/build-push-action from 5 to 6 by @dependabot in #71
  • Chore(deps): Update twine requirement from <5 to <6 by @dependabot in #69
  • Update urllib3 requirement from <2 to <3 by @dependabot in #12
  • Chore(deps): Update poethepoet requirement from <0.27 to <0.28 by @dependabot in #73
  • Chore(deps): Update ruff requirement from <0.5 to <0.6 by @dependabot in #75
  • Chore(deps): Bump fsspec[gcs,github,http,s3] from 2024.6.0 to 2024.6.1 by @dependabot in #76
  • Chore(deps): Update mypy requirement from <1.11 to <1.12 by @dependabot in #79
  • Chore(deps): Update validate-pyproject requirement from <0.17 to <0.19 by @dependabot in #80
  • CI: Update to Docker Compose V2 by @amotl in #82
  • Chore(deps): Update pyproject-fmt requirement from <2.2 to <2.3 by @dependabot in #81
  • Chore(deps): Update validate-pyproject requirement from <0.19 to <0.20 by @dependabot in #83
  • Chore(deps): Update ruff requirement from <0.6 to <0.7 by @dependabot in #84
  • Chore(deps): Bump fsspec[gcs,github,http,s3] from 2024.6.1 to 2024.9.0 by @dependabot in #86
  • Chore(deps): Update validate-pyproject requirement from <0.20 to <0.21 by @dependabot in #89
  • Add support for Python 3.12 by @amotl in #90
  • Chore(deps): Bump sqlalchemy-cratedb from 0.37.0 to 0.40.0 by @dependabot in #88
  • Update pandas requirement from <2 to <3 by @dependabot in #61
  • Chore(deps): Update numpy requirement from <2 to <3 by @dependabot in #77
  • Add support for Python 3.13 by @amotl in #91
  • Chore(deps): Update frictionless[excel,json,ods,parquet,sql] requirement from <5.6 to <5.19 by @dependabot in #87
  • Chore: Limit pandas dependency to <2.3 by @amotl in #97
  • This and that by @amotl in #98
  • Chore(deps): Update ruff requirement from <0.7 to <0.8 by @dependabot in #92
  • Chore(deps): Update poethepoet requirement from <0.28 to <0.30 by @dependabot in #93
  • Chore(deps): Update validate-pyproject requirement from <0.21 to <0.22 by @dependabot in #95
  • Chore(deps): Update mypy requirement from <1.12 to <1.13 by @dependabot in #96
  • Chore(deps): Update pyproject-fmt requirement from <2.3 to <2.5 by @dependabot in #100
  • Chore(deps): Bump fsspec[gcs,github,http,s3] from 2024.9.0 to 2024.10.0 by @dependabot in #94

New Contributors

Full Changelog: v0.1.0...v0.1.1

v0.1.0

22 Oct 07:36
Compare
Choose a tag to compare

What's Changed

  • Initial working version, supporting JSON
  • Add CLI subsystem
  • Add logging
  • Add SQL pretty printing
  • Improve software tests
  • Source: Unlock reading from stdin
  • Derive table name from input file name
  • Primary key detection
  • Format: Content type detection using file extension or --content-type option
  • Format: Add support for CSV input format
  • Format: Add support for XLSX and ODS input formats
  • Tests: Add test case for basic nested JSON document
  • Backend: Add frictionless backend
  • Format: Add support for Google Sheets and Parquet input formats
  • Performance: Improve sampling large files
  • Source: Support reading data from HTTP
  • Performance: Use the Hunter code tracing toolkit to trace execution path
  • Performance: Don't open resource twice when using frictionless backend
  • Performance: Improve peeking into Parquet files
  • Performance: Configure PEEK_LINES = 100 instead of 1000
  • Performance: Optimize reading from remote NDJSON files
  • Refactoring: I/O related code goes into skeem.io
  • Format: Add support for InfluxDB line protocol input format
  • Source: Unlock reading from public S3 buckets anonymously (--no-sign-request)
  • Source: Unlock and document reading from public Google Cloud Storage (GCS) buckets,
    and files on GitHub.
  • Tests: Add "roadrunner" tests, using a bunch of external resources. The tests
    will only check for successful invocation, and not verify the generated SQL.
  • Format: Add NetCDF input format
  • AutoPK: Fix heuristics where the first column is a dictionary
  • Format: Add GRIB2 input format
  • Refactoring: Rework skeem.type
  • Refactoring: Add skeem.io.open as a wrapper around fsspec.open
  • Refactoring: Add skeem.io.to_dataframe from skeem.autopk
  • Refactoring: Add skeem.util folder instead of single util.py
  • UX: Add skeem info subcommand
  • UX: Improve CLI help
  • Format: Add support for reading compressed files in Gzip format
  • CI: Run software tests on GHA
  • CI: Use versioningit for automatic package versioning
  • CI: Add OCI image builder to provide images for Podman, Docker, etc.

Full Changelog: https://github.com/daq-tools/skeem/commits/0.1.0