Improve source handling

[carlgieringer]

Core question

• Support multiple MediaExcerpts with the same quotation? (Improve MediaExcerpt equivalence calculation and support MediaExcerpt suggestions (see MediaExcerpts DAO))
  • Identical local reps with any overlapping Source/Locator should be equivalent
  • What if they have the same (or different) other localReps, such as screenshot?

Core feature

• Create MediaExcerpts from mobile #430
• Allow manual MediaExcerpt creation for creating justifications/appearances based on offline sources.
• Integrations
  • Source page, including editing & list of MediaExcerpts.
  • Main search:
    • Search sources by description
    • Search MediaExcerpts by quotation
    • Search MediaExcerpts by URL
    • Search MediaExcerpts by domain
  • JustifiedProposition
  • See usages of MediaExcerpts (search Justifications and Appearances.)
  • Recent MediaExcerpts
• Remove WritQuote from JustifiedProposition editor.
• Support adding locators to an excerpt
  • How to display similar locators (same URL, different anchor)? Show one URL along with multiple icons to see the different anchors? Just show separately now because of the creator issue.
  • When the creator of the UrlLocator differs from the creator of the MediaExcerpt, show it next to that item.
• Update the create MediaExcerpts endpoint both to confirm the quotation and to confirm or add DOM anchors to the UrlLocator (it's the localRep that needs confirmation, not the UrlLocator's anchors.)
  • We should store a timestamp when we successfully crawled a quotation so that we can display an icon locally indicating that it is confirmed to appear remotely.
• Address that we can get multiple identical URLs for a ME in the UI if they have different text fragments.
• Prepopulate the most popular Source description when creating a MediaExcerpt using a URL or domain with existing MediaExcerpts.
• Improve text-fragment-to-quotation and quotation-to-text-fragment process #500

Cleanup

Moved to (#508)

Later improvements

• Support adding citations and speakers to an excerpt (Support adding Citations and Speakers to a MediaExcerpt. #511)
• Integrate browser extension with MediaExcerpt UrlLocator navigation #514
• Convert locators, citations, and speakers to a voting model (Convert UrlLocators, Citations, and MediaExcerptSpeakers to a voting model #512/Support omnijustifiables/omnivotables #35)
• Further improve quotation confirmation (Improve approximate string search #507)
• Add on-demand (Implement on-demand UrlLocator confirmation #509) and scheduled (Implement scheduled UrlLocator confirmation #510) UrlLocator confirmation.
• Suggest other local reps having non-overlapping Source/Locator (user can click on one of the suggestions to add the current Locator to it.) Implement suggested MediaExcerpt #454
• Make it easy for user to add link to web.archive.org version (if it exists) (Make it easy for users to add UrlLocators to archive sites #513)
• Support additional media, like PDFs, YouTube videos, Spotify podcasts. (Support additional locators for PDFs, YouTube videos, Spotify podcasts #515)
• Fix anchors to be Chrome-compatible (Extension highlights are not compatible with Chrome's text fragment links #427)

Core features (done)

• Add pincites, which are like an anchor for offline sources
• Figure out how to model URL targets and anchors. (Possibly type extension first, Convert most of the browser extension to TypeScript #251, UrlTargetAnchor vs. TextQuoteAnchor.)
• Convert source-related JS Components to TS:
  • ./src/EditableWrit.js
  • ./src/WritViewer.js
  • ./src/TextField.js
  • ./src/UrlTextField.js
  • ./src/SingleLineTextField.js
  • ./src/Link.js
  • ./src/Checkbox.js
  • ./src/CheckboxList.js what's this?
  • ./src/PropositionCard.js
  • ./src/PersorgViewer.js
  • ./src/PersorgEditor.js
  • ./src/PersorgEntityCard.js
  • ./src/EditablePersorg.js
  • ./src/WindowMessageHandler.js