Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Revive extensions removed from AMO before October 2017 #43

Closed
45 tasks done
JustOff opened this issue Feb 5, 2019 · 1 comment
Closed
45 tasks done

Revive extensions removed from AMO before October 2017 #43

JustOff opened this issue Feb 5, 2019 · 1 comment
Labels
data restore enhancement

Comments

@JustOff
Copy link
Owner

JustOff commented Feb 5, 2019 •
edited
Loading

  • Collect add-ons
    • Sent by misc volunteers
    • thereisonlyxul.org
    • kr.vim.org
    • metu.edu.tr
    • easynews.com
  • Prepare scripts
    • metadata.xml parser
    • xpi package parser
    • icons extractor
    • db analyzer
    • db updater
    • creation time fixer
  • Analyze and prepare data
    • Compare and exclude duplicates
      • thereisonlyxul.org
      • kr.vim.org
      • metu.edu.tr
      • easynews.com
    • Create metadata.xml for add-ons sent by volunteers
    • Add known authors to [name, slug, id] table
    • Generate temp [name, slug, id] records for other authors
    • Deal with missed summaries
    • Work around install.rdf with wrong charset
    • Deal with slug duplicates
    • Deal with improbable creation times
  • Prepare icons
    • Extract from xpi files
    • Download from archive.org
    • Convert to png and limit size to 64x64
    • Optimize using PNGoo/PNGGauntlet
  • Prepare files to be added
    • Revived that already listed in db
    • Auto-discovered by scripts
    • Manually parsed due to improperly encoded install.rdf
  • Perform update and release
    • Update CAA to correctly display add-ons with unknown stats
    • Fix creation times сorrupted on March 5, 2007
    • Update existing links to revived files
    • Add "not determined" license type
    • Add new records to CAA db
    • Add new icons to CAA
    • Upload new files to CDN
    • Verify everything in complex
    • Publish new CAA release
This was referenced Feb 5, 2019
Closed
Closed
Closed
This was referenced Feb 13, 2019
Closed
Open
@JustOff JustOff pinned this issue Feb 13, 2019
@JustOff JustOff unpinned this issue Feb 13, 2019
@JustOff
Copy link
Owner Author

JustOff commented Mar 5, 2019

Resolved by CAA 2.0.1.

Before: 75,929 versions of 16,706 add-ons
After: 93,598 versions of 19,450 add-ons

@JustOff JustOff closed this as completed Mar 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
data restore enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JustOff