Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sqlite split #1337

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

Sqlite split #1337

wants to merge 19 commits into from

Conversation

patrickdalla
Copy link
Collaborator

Improvement in SQLite Parser, so it split large tables in pieces of size configured in a parser configuration parameter, and extract date metadata from REAL columns (apple most common format) and geolocations based on column names.

@lfcnassif
Copy link
Member

Thank you @patrickdalla.

@lfcnassif
Copy link
Member

Thanks @patrickdalla!

@patrickdalla
Copy link
Collaborator Author

This pull requests also closes #2043, at least in a way that is usable by SQLite Split implementation.

All metadata values must be placed in an array list before being added to avoid the tika original implementation performance issue. If metadata values are added individually, the original behavior will still occur.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants