Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bulk update via XML #13

Closed
elizoller opened this issue Nov 27, 2019 · 7 comments
Closed

Bulk update via XML #13

elizoller opened this issue Nov 27, 2019 · 7 comments
Assignees
Milestone

Comments

@elizoller
Copy link
Contributor

Use Case: As a metadata manager/cataloger/administrator, I want to bulk export and import batches of legacy metadata (in multiple formats such as XML, RDF, and/or spreadsheet, etc. if possible) so that the metadata can be efficiently batch edited, normalized, transformed, etc. and re-ingested into the repository.

@elizoller
Copy link
Contributor Author

bulk edit via UI can supposedly be achieved via https://www.drupal.org/project/views_bulk_edit and https://www.drupal.org/project/views_entity_form_field

@elizoller elizoller changed the title Bulk update via CSV Bulk update via XML Aug 31, 2020
@elizoller
Copy link
Contributor Author

Since metadata team prefers to work in a bulk sense in MODS XML instead of CSV, the migration of MODS XML referenced in #11 would also work for updating existing records as long as the node id matched.

@elizoller elizoller modified the milestones: Bulk Actions, Q1 2021 Jan 6, 2021
@wgilling wgilling self-assigned this Jan 7, 2021
@elizoller elizoller self-assigned this Jan 7, 2021
@elizoller
Copy link
Contributor Author

ultimately #11 will probably be the same thing

@wgilling
Copy link
Contributor

So, do we want this to give the ability of users with a certain role to go into the website and go to a specific "MODS import / update" form and let the user upload a single MODS or modsCollection XML that will in turn execute the drush migrate:import migrate_plus.migration.mods_xml.yml using the url that points to the uploaded XML? I assume this code would also have to template to provide values for the migration's id: p_c284_node
label, and migration_group (like id: p_c284_node, label: Import Collection 284 from CSV, migration_group: migrate_c284_csv).

@wgilling
Copy link
Contributor

I missed the details that were in issue #11 about how that would use the migrate_source_ui module to allow uploading and handle most of what we need to do here.

@wgilling
Copy link
Contributor

The possibility of creating duplicate content with the single mods_xml migration is a slight concern since there is no way to provide a warning when a user is trying to update a node vs creating a new node, and they upload an XML file that does not contain the aztes value (in the recordInfo/recordIdentifier[@src="aztes"] node).

I proposed rebranding the mods_xml as "mods_xml_update" and adding a second instance of the same migration except that this one does not have the "skip_on_empty" for the nid field (so it would fail if using the update and the aztes is missing). This second instance could be called mods_xml_create.

@wgilling
Copy link
Contributor

wgilling commented Jan 28, 2021

The previous commit includes a patch (web/modules/custom/asu_migrate/source_ui_url.patch) that could address the migrate_source_ui issue "JSON and XML migrations not being detected?" https://gitlab.com/drupalspoons/migrate_source_ui/-/issues/16

wgilling added a commit that referenced this issue Feb 2, 2021
wgilling added a commit that referenced this issue Feb 4, 2021
…e import-only and update-only mods_xml migrations for #13
wgilling added a commit that referenced this issue Feb 4, 2021
… field_subjects_name and field_linked_agent for #13
wgilling added a commit that referenced this issue Feb 8, 2021
…s, also coded for uid to come from asurite or drupal username for #13
elizoller added a commit that referenced this issue Feb 11, 2021
Ready to merge - this is prerequisite for "Import/Update MODS" #13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants