All notable changes to Datura will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
Unreleased - Brief description TBD before next release
v0.2.0 - Ingest documentation, text spacing, and date_standardize
- minor test for Datura::Helpers.date_standardize
- documentation for web scraping
- documentation for CsvToEs (transforming CSV files and posting to elasticsearch)
- instructions for installing Javascript Runtime files for Saxon
- date_standardize now relies on strftime instead of manual zero padding for month, day
- minor corrections to documentation
- XPath: "text" is now ingested as an array and will be displayed delimitted by spaces
- check to make sure "text" xpath is doing desired behavior
v0.2.0-beta - 2020-08-17 - Altering field and xpath behavior, adds get_elements
- Fields (and therefore methods) for ES JSON, such as extent, alternative, spatial, etc
- Methods to xToES format fields to accommodate default behavior
- ES JSON
uri
now populated using default Orchid item path - Tests and fixtures for all supported formats except CustomToEs
get_elements
returns nodeset given xpath argumentsspatial
nested fieldsspatial.type
andspatial.title
- Arguments for
get_text
,get_list
, andget_xpaths
- XPaths for VRA and TEI to Elasticsearch
- Default behavior for CsvToEs for some fields
- Documentation updated
- Changed Install instructions to include RVM and gemset naming conventions
- API field
coverage_spatial
is now justspatial
- Change
coverage_spatial
nested field tospatial
get_text
,get_list
, andget_xpaths
require changing arguments to keyword (likexml
andkeep_tags
)- Recommend checking xpaths and behavior of fields after updating to this version, as some defaults have changed
- Possible to refactor previous FileCsv overrides to use new CsvToEs abilities, but not necessary
v0.1.6 - 2020-04-24 - Improvements to CSV, WEBS transformers and adds Custom transformer
- CsvToEs class added which imitates style of other XToEs classes for easier overriding / maintenance
- Custom formats now supported, although no functionality provided since the type of format cannot be predicted
- Adds documentation for custom format setup
- CSV to ES transformation no longer accepts default column names, but instead looks for columns matching ES fields to use
- FileType elasticsearch transform now has swappable component when reading XML-type files. Webscraping script altered to manipulate HTML instead of XML object type
- CSV to ES transformation used to automatically assume columns as ES fields, this functionality has been removed
v0.1.5 - 2020-02-03 - VRA to Solr
- VRA to Solr field "topic" set up with basic functionality
- Upgraded Ruby version to 2.7.0, updated gems
- VRA to Solr field "text" fixed to post correctly
- VRA to Solr field "people" and "language" made overridable
- Updated URL to Saxon HE software
v0.1.4 - 2019-09-17 - PB Update
- Removed match on
pb/@xml:id
for tei-to-html
v0.1.3 - 2019-08-21 - IIIF Manifests
- IIIF output format and documentation
- Changelog
- nokogiri gem restricted to moving minor version instead of patch
- pkg builds of gem
- outdated comment line
v0.1.2 - 2019-05-15 - Web scraping support, post by update time fix
webs
format for minimal support of web scraping by specific appstoday
shortcut for--update
flag
--update
flag fixed
v0.1.1 - 2019-03-01 - Pre and post file transformation hooks
- ability to manipulate files before and after transformation
- accomodates ruby 2.6.x
v0.1.0 - 2018-11-21 - Datura Gem Launch
- creates the datura gem
This release contains code as the data repository used to be when it was a collection of scripts. After this point, it will be a gem named "datura."