v0.9.0

Added

• Command fiboa improve with helpers to
  • change the CRS
  • change the GeoParquet version and compression
  • fill missing perimeter/area values
  • fix invalid geometries
  • rename columns
• Converter for Lithuania (EuroCrops)
• Converter for Slovenia
• Converter for Slovakia
• Converter for Switzerland
• Converter for Czech
• Converter for US Department of Agriculture Crop Sequence Boundaries
• Converter for California (US) Statewide Crop Mapping
• Converter for Latvia (from original source)
• Converter for Japan, currently based on supplied (non-fiboa) parquet files
• fiboa convert: New parameter --original-geometries / -og to keep the original geometries

Changed

• fiboa convert:
  • Writes custom schemas to collection metadata
  • Geometries are made valid using GeoPanda's make_valid method by default
  • MultiPolygons are converted to Polygons by default
• fiboa validate uses custom schemas for validation
• fiboa merge keeps custom schemas when needed
• Extended converter for Croatia; with crop_code and crop_name
• Many converters implement the admin extension

Removed

• fiboa convert: Removed the explicit parameter explode_multipolygon from the converter

Fixed

• Fix converter for Estland to use the id ec_ee instead of ec_es
• Assure tests don't download external sources

v0.8.0

Added

• Merge command: fiboa merge
• Converter for Croatia
• Converter for Germany, Mecklenburg-Western Pomerania
• Converter for Germany, Saarland
• Converter for Germany, Saxony
• Converter for Estonia (EuroCrops)
• Converter for Sweden
• Converter for Luxembourg
• Converter for Ireland
• Converter for Lacuna Labels (A region-wide, multi-year set of crop field boundary labels for Africa)

Changed

• fiboa convert: Default compression changed from zstd to brotli
• The default row group size of exported parquet files was changed from ~1.000.000 to 25.000

Fixed

• Datatype conversion from pandas to pyarrow fixed

v0.7.0

Added

• Converter for Luís Eduardo Magalhães (LEM) and other municipalities in the west of Bahia state, Brazil (br_ba_lem)
• Converter for Denmark (dk)
• Additional converters for EuroCrops datasets: ec_be_vlg, ec_nl_crop
• New parameter --geoparquet1 to generate GeoParquet 1.0 without bbox column instead of GeoParquet 1.1 with bbox column

Changed

• CLI creates GeoParquet 1.1 with bbox column by default
• The function signature in the convert function of the converters has changed to a simpler more future-proof variant.
• The EuroCrops converters extend the original converters

Fixed

• fiboa convert: Create output folder if it doesn't exist
• Strip whitespaces/newlines from created STAC collections
• fiboa create-geojson: Don't write FeatureCollections to folder if a filename is given

v0.6.0

Added

• Added a SHORT_NAME variable to the converter template
• Added a FILE_MIGRATION variable to the converter template for per-file migrations
• Added a LAYER_FILTER variable to the converter template for loading specific layers from a file
• Added -i parameter to specify input files for converters
• fiboa converters output can be customized with options -p, -s and -v.
• fiboa convert reads JSON file with custom logic, which allows to access nested objects through dot notation
• Converter for Slovenia via EuroCrops (ec_lv)
• Converter for Planet's Automated Field Boundary (planet_afb)
• Converter for Portugal (pt)
• Converter for DigiFarm (digifarm)
• Converter for AI4SmallFarms in Cambodia and Vietnam (ai4sf)
• Further tests

Changed

• The BBOX is optional in the converter template as it will be computed automatically from the data.
• The PROVIDER_NAME and PROVIDER_URL variables in the converter template were replaced by PROVIDERS
• fiboa converters is more readable by default
• Upgraded to geopandas 1.0.0, which migrates from fiona to pyogrio for data loading
• The EuroCrops converters (prefix: ec_) use the HCAT fiboa extension

Fixed

• Fixed schema issue for the tk10 column in de_bb converter
• jsonschema library doesn't warn against external references any longer

v0.5.0

Added

• Basic support for patternProperties in GeoParquet creation
• The converter template accepts multiple input URLs
• Added parameter to explode multipolygons to polygons (explode_multipolygon, default: False)
• Converter for Belgium, Flanders (be_vlg)
• Converter for Belgium, Wallonia (be_wa)
• Converter for Finland (fi)
• Converter for France (fr)
• Converter for The Netherlands (nl and nl_crops)
• Converter for Slovenia via EuroCrops (ec_si)

Changed

• The --cache option for the convert command asks for a folder instead of a file
• The cache_file parameter in converters has been renamed to cache (requires changes in the converter templates)
• The converter template allows for more detailed source information
• The URI constant in the template was renamed to SOURCES (requires changes in the converter templates)

Fixed

• Extensions were not correctly displayed in describe and validate command
• Fixed regular expressions for email and uuid in data validation

v0.4.0

Added

• Converter for EuroCrops France dataset
• fiboa create-geojson: Show conversion progress
• fiboa jsonschema and fiboa validate: Support geometryTypes for geometry data type in GeoJSON
• fiboa validate:
  • Basic validation for objects, geometries and bounding boxes in GeoParquet files

Fixed

• fiboa validate-schema: The -m option is applied correctly if $schema is present in schema
• fiboa validate and fiboa validate-schema: Don't stop validation after the first file.
• fiboa validate:
  • Is more robust against invalid collections and doesn't abort if not needed
  • Check NULL values correctly in case of arrays
  • Throw an error if no files were provided
• fiboa create-geojson:
  • Handles GeoParquet bbox correctly
  • Converts numpy arrays
  • Doesn't export empty collections
• Fix recursive import

v0.3.10

Added

• fiboa convert:
  • Added step that allows to set constant values (ADD_COLUMNS)
  • Support for reading GeoParquet files
  • Help lists all available converters
• fiboa converters: More detailed list of available converters/datasets

Changed

• fiboa convert:
  • determination_datetime is not required any longer
  • Default compression changed from brotli to zstd

v0.3.9

Fixed

• JSON Schema and GeoJSON validation also errors when the data doesn't comply to the given formats

v0.3.8

Added

• Converter for Thuringia, Germany (de_th)

Fixed

• Fixed GeoJSON to GeoParquet conversion of the date data type

v0.3.7

Fixed

• Small fixes in CLI output and docs