Hyphe changes ":" in to-be-crawled URLs in "%3A"

[Guillaume-Levrier]

Here is what I get in my web entity:

ID
4

Name
##rnhub.com /.../page:4

Status
IN

Home page
link http://##rnhub.com/details/news/page%3A4

This obviously goes to a 404, making the web entity uncrawlable. Any solution?

[boogheta]

example url: https://www.altmetric.com/details/23373063/news/page:1
notes for later:

• try to add ':' in safechars line 260 of hyphe_backend/lib/urllru.py
• handle also in front ?

[Guillaume-Levrier]

Problem solved, thx.

[boogheta]

let's keep it open so that we can remember to fix it for everyone plz :p