Create batch jobs for preservation #890
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jazairi
force-pushed
the
etd-553-batch-jobs-for-preservation
branch
from
10c3314 to
3233a5c
Compare
jazairi
force-pushed
the
etd-553-batch-jobs-for-preservation
branch
from
3233a5c to
127a637
Compare
jazairi
force-pushed
the
etd-553-batch-jobs-for-preservation
branch
from
127a637 to
0a7e294
Compare
JPrevost
approved these changes
Feb 3, 2022
README.md
Outdated
| streamed to an S3 bucket. (See the SubmissionInformationPackage and SubmissionInformationPackageZipper classes for more | ||
| details on this part of the process.) | ||
|
|
||
| Once the bags are in the S3 bucket, they are replicated to the Digital Preservation S3 bucket, where they can be |
There was a problem hiding this comment.
Suggestion they are replicated become they are automatically replicated
| @@ -2,7 +2,7 @@ | |||
|
|
|||
| class SubmissionInformationPackageZipperTest < ActiveSupport::TestCase | |||
|
|
|||
| # because we need to actually use the file it's easier to attache it in the test rather | |||
| # because we need to actually use the file it's easier to attach it in the test rather | |||
There was a problem hiding this comment.
Parce qu'on le parle pas.
Why these changes are being introduced: We need a way to initiate SIP creation, bagging and streaming to S3. Relevant ticket(s): https://mitlibraries.atlassian.net/browse/ETD-553 How this addresses that need: This creates two jobs: 1. PreservationSubmissionJob attempts to send a single thesis to preservation and modifies the preservation_status and preserved_at fields accordingly. 2. PreservationSubmissionPrepJob loops through an array of theses to preserve. Side effects of this change: * preservation_status is now an enum with three options: unpreserved (the default), preserved, and error. * Adds `preservation.rake` task to send a single thesis to preservation via Rails CLI. * The readme now indicates that the publishing workflow automatically kicks off the preservation workflow. This is not yet accurate, but will be once ETD-560 is implemented.
jazairi
force-pushed
the
etd-553-batch-jobs-for-preservation
branch
from
0a7e294 to
3d35766
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why these changes are being introduced:
We need a way to initiate SIP creation, bagging and streaming to
S3.
Relevant ticket(s):
https://mitlibraries.atlassian.net/browse/ETD-553
How this addresses that need:
This creates two jobs:
preservation and modifies the preservation_status and preserved_at
fields accordingly.
to preserve.
Side effects of this change:
(the default), preserved, and error.
preservation.raketask to send a single thesis topreservation via Rails CLI.
Developer
our guide and
all issues introduced by these changes have been resolved or opened as new
issues (link to those issues in the Pull Request details above)
Code Reviewer
(not just this pull request message)
Requires database migrations?
YES
Includes new or updated dependencies?
NO