This is the repository for Version 3.0b (beta) of the World Historical Gazetteer (WHG) web platform and API. Its replaces Version 2.1 on 19 June 2024.
WHG is an open-source project and welcomes contributions of content and code. Please see this document for an overview of how to participate in the several aspects of WHG development. Specific tasks in our long TODO queue will be added as GitHub issues soon. This repository can be forked and cloned as a Docker project with the procedure outlined here.
- New "Place Collection" feature, added to existing "Dataset Collection" capability. Place Collections can be composed of individual place records from one or more datasets (or entire datasets) related to each other in some way. Each record can be annotated to explain its inclusion, and the collection itself can include images, links, and an uploaded file.
- Added 'Teaching' section of the site. Eight lesson plans included to start, primarily high school level
- New "Collection" feature added, with two early examples: "Dutch History" and "HGIS de las Indias"
- Revamped search functionality: option to search database as well as index; filter results by type, country, map bounding box; return to results from place pages
- Public views for datasets, collections, and individual records
- Dataset and Collection maps now using MapLibreGL, for fast rendering of large datasets
- Reliablity and error reporting for upload functions improved
- Rewritten documentation; new tutorial on LP-TSV creation and new sample lesson plan
- SSL (https) enabled
- Formation of an editorial team has begun
- Redesigned home page
- Code refactoring and cleanup
- New 'deferred' queue for reconciliation tasks
- Reconciliation review status per-record and per-task now tracked on Dataset > Browse screen
- Reconcile-to-WHG (accessioning) now finds candidate sets within WHG index, not individual records
- Collections feature enabled for beta testers
- New local 3.5m record Wikidata index for reconciliation
- New and improved authorization functions (register, login, password recovery)
- Add dataset collaborators in 'member' or 'co-owner' roles
- Reconciliation task progress tracking and status feedback improved
- Support for uploading & validating .csv, .xlsx, and .ods formats added
- Compute country codes if absent & geometry present
- Fixes: wikidata links; reporting upload errors; temporal data parsing
- Reconciliation tasks now queued, and dataset owner notified by email upon completion.
- Base map replaced w/Natural Earth tiles
- Numerous minor bug fixes
- Additional data accessioned: 28,000 historical records from Pleiades, Euratlas, and OWTRAD datasets.
- APIs for access to the database and the Elasticsearch index. Site search is against accessioned and conflated records in the index, but data uploaded to the database is discoverable as well, if flagged 'public'
- Additional trace data added. 70 new sets of annotations
- Search function significantly updated. Filters for feature class/category, spatial, temporal constraints.
- Comprehensive Site Guide added.
- Download datasets, before and after augmenting via reconciliation.
- Recover password functionality.
- Numerous GUI improvements and fixes. Including redesign of home page.
-
Dataset downloads. Options from dataset detail panel to download a) latest uploaded data file as is, b) augmented dataset (includes any geometries and/or concordance 'links' added during reconciliation review step).
-
Draft public API. Parameters include q=, dataset=, ccodes=. E.g.
/api/?q=abydos&dataset=black&ccodes=eg -
Misc minor UI fixes.
-
Core data significantly expanded. Added ~1.5 million place records from Getty Thesaurus of Geographic Names (TGN), and ~1,000 large cities from GeoNames to WHG index. Contributions from historical sources will, in addition to adding novel entries, add "temporal depth" to these ahistorical data.
-
Dataset updates. Dataset owners are now able to perform updates by uploading new data files. Analysis of the changes to be made (add, remove, replace) is performed automatically, and presented for review before performing them. NOTE: available only for LP-TSV format currently. Linked Places format will follow soon, as will enhancements to file management.
-
"Collaborator" role. Dataset owners can specify any number of registered users as collaborators, able to view non-public data and assist in review of reconciliation results; effectively, dataset project teams.
-
Undo last reconciliation match. When moving quickly through prospective matches in the reconciliation review task, it is possible to inadvertently save a match; we've added a single step undo of the last action.
-
Dataset management functions consolidated. Single page with tabs for Metadata, Browse, Reconciliation, Collaboration functionality.
- Django 2.2.10
- Python 3.7.4
- PostgreSQL 10
- Elasticsearch 7.17
- Nginx 1.14.0
- Gunicorn 19.9.0
- Celery 4.2.1
- Bootstrap 4
- JQuery 3.3.1
- MapLibre.js
- Leaflet 1.3.1