Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate dummy sitemaps from Datacite queries #61

Open
iannesbitt opened this issue Apr 2, 2024 · 1 comment
Open

Generate dummy sitemaps from Datacite queries #61

iannesbitt opened this issue Apr 2, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@iannesbitt
Copy link
Contributor

iannesbitt commented Apr 2, 2024

Datacite does not have a dataset-focused sitemap. In order to scrape schema.org metadata, mnlite would need to generate a dummy sitemap from Datacite API queries. Parameters would need to include (probably):

  • workflow specification: (for example: "workflow": "datacite")
  • client ID (for example, for GEM: dk.gem -> https://api.datacite.org/dois?client-id=dk.gem&page[size]=1000)

JSON -> sitemap value mappings:

---
title: Value map for Datacite dummy sitemap creation
---
flowchart LR
    id["JSON:id"]
    api["sitemap entry with url tags enclosing https://api.datacite.org/dois/{id}"]
    updated["JSON:attributes:updated"]
    lastmod["lastmod tags enclosing {updated}"]
    url["JSON:attributes:url"]
    mnurl["sysmeta url of {url}"]
    id --> api
    updated --> lastmod
    url --> mnurl
   
Loading

When requesting individual records from the dummy sitemap, mnlite will use content negotiation to request JSON-LD 🎉

@iannesbitt iannesbitt added the enhancement New feature or request label Apr 2, 2024
@iannesbitt iannesbitt self-assigned this Apr 2, 2024
@iannesbitt
Copy link
Contributor Author

Datacite API docs: https://support.datacite.org/docs/api

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant