Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Title extraction in indexer is based on the WARC headers and not HTTP headers #568

Closed
machawk1 opened this issue Sep 25, 2018 · 0 comments
Closed

Title extraction in indexer is based on the WARC headers and not HTTP headers #568

machawk1 opened this issue Sep 25, 2018 · 0 comments
Assignees
@machawk1
Labels
bug ipwb indexer

Comments

@machawk1
Copy link
Member

This prevents a title from ever being extracted, as no WARC header will have a Content-Type of text/html, e.g., The Content-Types of WARC records are Content-Type: application/http; msgtype=response.

PR incoming.
@machawk1 machawk1 self-assigned this Sep 25, 2018
machawk1 added a commit that referenced this issue Sep 25, 2018
@machawk1
Merge pull request #569 from oduwsdl/issue-568
28c9cf6 
Fix title extraction to use HTTP and not WARC headers. Closes #568
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@machawk1 machawk1

Labels
bug ipwb indexer
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@machawk1