Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add new fields to 2.0 schema #220

Closed
wants to merge 18 commits into from
Closed

add new fields to 2.0 schema #220

wants to merge 18 commits into from

Conversation

wkdewey
Copy link
Contributor

@wkdewey wkdewey commented May 4, 2023 •
edited

Fixes #219

@wkdewey wkdewey requested a review from techgique May 4, 2023 17:33
@wkdewey wkdewey changed the title add new fields to 2.0 schema DRAFT add new fields to 2.0 schema May 4, 2023
@wkdewey
Copy link
Contributor Author

wkdewey commented May 4, 2023

tested it on the Habeas repo (csv and tei ingest) and it posts correctly.

@wkdewey wkdewey changed the title DRAFT add new fields to 2.0 schema add new fields to 2.0 schema May 4, 2023
@wkdewey wkdewey linked an issue May 16, 2023 that may be closed by this pull request
Add more fields to Datura for new schema #219
Open
wkdewey and others added 16 commits June 13, 2023 15:51
@wkdewey
create methods and overrides to transform pdf files to elasticsearch
aa0770b
@wkdewey
add pdf option for command line options
16a421b
@wkdewey
fix variable names
d3f87be
@wkdewey
adjust and clarify documentation for adding new formats
ab921b7
@wkdewey
fix comments
d0ba3f0
@wkdewey
fix html transformation method
13ba8f7
@wkdewey
clarify that this is not yet implement
68842a9
@wkdewey
add keywords5 to pdftoes fields
1f612a7
@wkdewey
add has_relation to pdftoes fields
43a5821
@wkdewey
add has_source to pdftoes fields
9fe353c
@wkdewey
add xpath for notes
caed7ba 
related to whitmanarchive/whitman-issues#34
@wkdewey
add note xpath to text fields
91dcfc3 
related to whitmanarchive/whitman-issues#34
@wkdewey
truncate pdf text so it doesn't exceed ES limit
867cad7 
fixes whitmanarchive/whitman-issues#273
@techgique
Update solr_clear_index to use renamed method in parser code
4dfd67b 
Parser code and es bin files were updated together across a couple commits:
- b01397a
- 419a8fd

This file should have been updated as well
@techgique
Merge pull request #217 from CDRH/pdftoes
5cc6c87 
PDF to ES
@techgique
Output schema in human readable format
b680e70
@wkdewey
Copy link
Contributor Author

wkdewey commented Aug 20, 2024

all changes are in whitman-fixes

@wkdewey wkdewey closed this Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@techgique techgique Awaiting requested review from techgique

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add more fields to Datura for new schema
2 participants
@wkdewey @techgique