Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSV file #2650

Closed
CDM1CDM opened this issue Mar 8, 2023 · 12 comments
Closed

CSV file #2650

CDM1CDM opened this issue Mar 8, 2023 · 12 comments
Labels
enhancement New feature or request

Comments

@CDM1CDM
Copy link

CDM1CDM commented Mar 8, 2023

Hello. Thanks for putting this site together. Would it be possible to publish a nightly (or as the data changes) .csv file of your fields and the data rendered therein? This would be an incredibly useful data format for teams working with Splunk and other SEIM tools that don't have internet access for the api, or work in air-gapped environments but need this data. I would publish a write-up on my blog https://slice2.com/ (your data used as a Splunk lookup) to help evangelize your work.

Release Released Active Support Security Support Latest

Thanks,

CDM1CDM

@CDM1CDM CDM1CDM added the enhancement New feature or request label Mar 8, 2023
@welcome
Copy link

welcome bot commented Mar 8, 2023

Thank you for opening your first issue here 👍. Be sure to follow the issue template if you chose one.

@adriens
Copy link
Contributor

adriens commented Mar 8, 2023

@marcwrobel
Copy link
Member

Hi @CDM1CDM, would a JSON export work for you?

Product schema have multiple level of data that cannot be represented (at least easily) in CSV. For examples the releases field is a sublist with a variable number of element, and each of those elements have their fields. See https://deploy-preview-2080--endoflife-date.netlify.app/api/v1/products/almalinux/ for example (releasesis named cycles in this JSON payload)

Plus we already had a request to export the full dataset in JSON format (#2530).

@adriens
Copy link
Contributor

adriens commented Mar 14, 2023

Hi guys, I finally could manage to get something quite consistant, check https://www.kaggle.com/code/adriensales/endoflife-date-offline-copy/notebook

exports.tar.gz

@adriens
Copy link
Contributor

adriens commented Mar 14, 2023

The schedule is daily 💪

@adriens
Copy link
Contributor

adriens commented Mar 15, 2023

@CDM1CDM , let me know about the "fresh" csv you can now get

👇

@adriens
Copy link
Contributor

adriens commented Mar 16, 2023

TADA ✨

adriens/endoflife-date-snapshots/issues/6#issuecomment-1471305488

duckdb -c 'SELECT * from read_csv_auto("https://raw.githubusercontent.com/adriens/endoflife-date-snapshots/main/data/details-with-headers.csv");'

@adriens
Copy link
Contributor

adriens commented Mar 16, 2023

@marcwrobel
Copy link
Member

marcwrobel commented Jul 30, 2023

Closing this as:

  • @CDM1CDM never replied to the comments
  • a CSV export of all the data is not possible (products and versions cannot be in the same file)
  • some alternatives were provided.

@marcwrobel marcwrobel closed this as not planned Won't fix, can't repro, duplicate, stale Jul 30, 2023
@adriens
Copy link
Contributor

adriens commented Jul 30, 2023

As soon as V1 will have been officialy released, I'll deliver the data on a daily basis on various systems so people will be able to get that kind of things.
For now I keep the work private as it is subject to changes.... but it runs on a daily basis. 😸

@CDM1CDM
Copy link
Author

CDM1CDM commented Jul 31, 2023 via email

@CDM1CDM
Copy link
Author

CDM1CDM commented Jul 31, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants