Releases: medialab/hyphe
Releases · medialab/hyphe
Sum' 21
ChangeLog:
Early 2021
ChangeLog:
- Fix WebEntityCreationRules not taken into account anymore after corpus reset (#392)
- Better handle startpages manually from the front as batch (#352 #365 #336)
- Fix use of htpasswd to lock instances in docker builds (#390)
- Improve & fasten docker builds & CI autodeploys (#339 #374)
- Updated list of automatically followed redirection domains in docker builds
- Allow to set tags from API when creating a WebEntity
- Ensure settings input from frontend are valid (#360)
Winter 2019
ChangeLog:
- Settings can now be adjusted when creating a new corpus (#229)
- Network pages improvements (search nodes #255, view links direction #286, colors #311)
- Admin page improvements (filter, order, backup and reindex actions, destroy all button... #264)
- Links from OUT and DISCOVERED entities not taken into account anymore when computing WEs indegree (#232)
- First version for displaying each WE's ego network (#316 #204)
- Export buttons for crawls metadata in All crawls page (#319)
- Fix starting crawls with many many prefixes and startpages previously impossible (#353)
- Use imported urls as startpages when importing preexisting webentity (#365)
- Handle case of nested imbricated WebEntities for crawls (#326)
- Updated list of redirection domains to follow when crawling (#346)
- Fix missing www for creationrules with a path prefix (#363)
- Minor frontend improvements (login #239 #279, prospect #323, webentity edit #314 #304, pages network #335, startpages #324, homepage #340, crawls #297, ...)
- Add API routes to collect crawled pages metadata & html content when option activated
Many thanks to @2LaMa who's behind a lot of these improvements!
Fall 2019 (fixes 2 breaking bugs + minor fixes)
ChangeLog:
- Fix "homepage" mode for automatic startpages (breaking crawls from prospect on some settings)
- Fix some breaking calls to get_tags with no namespace
- Fix action menu in List WebEntities sometimes not triggered
- Better handle errors coming from empty calls (closes #337)
Summer 2019 (fix issues with big webentities)
Changelog:
- Use traph 1.2.0 with paginated queries to fix issues collecting all pages and pagelinks of a single webentity at once (#293), also fasten collecting childentities and cache number of pages by entity during network computation
- Fix broken WebEntity pages network view
- Add number of pages per webentity to WebEntities Lists, as well as exports and network view
- Fix creationrules missing after resetting a corpus (#320)
- Fix password protected access to corpora
- Always include homepage as a startpage when crawling a discovered (#322)
- Fix various crawler errors
- Allow editing a tag in a single API call instead of removing then adding
- Add script to trigger backup for all existing corpora
Spring 2019 (upgraded crawler)
Changelog:
- Upgraded Scrapy (0.24.6 -> 1.6) and ScrapyD (1.0.1 -> 1.2.0) versions to latest ones, fixing broken crawls on many https websites (#268 #273 #312 #270) and broken Docker installs on some Windows and Mac machines
- Upgraded Hyphe-Traph (1.0.0 -> 1.1.0) for faster homepages automatic identification
- Upgraded Graphology (0.11.4 -> 0.14.1) & Sigma (2.0.0-alpha18 -> 2.0.0-alpha20) for small networks fixes
- Improved Tags Inputs in Frontend's "WebEntity edition" and "Manage Tags" pages
- Transformed FREETAGS into actual research "Field notes" preparing HyBro's coming new direction (#296)
- Plenty of minor backend & frontend fixes (#305 #291 #310 #302 #281 #276 #248 #244 #275 #236 #294 #290 #258 ...)