Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cloud Storage of JSON Files #130

Open
kdk1616 opened this issue Aug 18, 2020 · 2 comments
Open

Cloud Storage of JSON Files #130

kdk1616 opened this issue Aug 18, 2020 · 2 comments
Labels
enhancement New feature or request ICTS on hold Will not be worked on until further notice

Comments

@kdk1616
Copy link
Collaborator

kdk1616 commented Aug 18, 2020

  • Requires database (see notifications)
  • Store users old JSON files from past years on server (so they don't get lost) Notifications #94
  • Can be automatically imported when users logs in
@kdk1616 kdk1616 changed the title Cloud Storage of JSON File Cloud Storage of JSON Files Aug 18, 2020
@notrodes
Copy link
Collaborator

Maybe a hotness-o-meter. That way infrequently accessed files can be serialized and zipped etc. . JSON is not an archival format

@psvenk
Copy link
Member

psvenk commented Aug 28, 2020

Maybe a hotness-o-meter. That way infrequently accessed files can be serialized and zipped etc. . JSON is not an archival format

JSON is good enough for archival. My largest export file is only 214 kilobytes, but this is 14.8K gzipped and 12K after Zstandard, which is also faster than gzip. If we choose to compress with one of these algorithms, the time it takes to compress would be so small that there would be no point triaging files and we might as well compress every one of the JSON files stored on the server.

@psvenk psvenk added enhancement New feature or request on hold Will not be worked on until further notice labels Oct 23, 2020
@tektaxi tektaxi added the ICTS label Dec 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ICTS on hold Will not be worked on until further notice
Projects
None yet
Development

No branches or pull requests

4 participants