-
Notifications
You must be signed in to change notification settings - Fork 35
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve all taxonomies (CSET and GMF) CSV export #3082
Improve all taxonomies (CSET and GMF) CSV export #3082
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## staging #3082 +/- ##
===========================================
+ Coverage 79.25% 79.34% +0.09%
===========================================
Files 165 165
Lines 13263 13263
Branches 1524 1527 +3
===========================================
+ Hits 10511 10523 +12
+ Misses 2459 2447 -12
Partials 293 293 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Anywhere I can see this working?
@cesarvarela Yes, I just updated the PR description with the testing instructions. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@cesarvarela It's ready for another review. Now it convert Array of values into comma-separated values as you suggested. |
3f67946
into
responsible-ai-collaborative:staging
Part of #3023
On top of #3030
This PR changes the way that we export taxonomies CSV files.
Now it iterates through all taxonomies on the taxa collection, dynamically generating a CSV file based on the fields of each taxonomy and the data from the classifications collection.
Based on the current data, it will produce these 5 CSV files:
Testing
To test these changes, please go to the Pablo's fork repository and run the GitHub Action manually:
https://github.com/pdcp1/aiid/actions/workflows/db-backup.yml
The backup file will be uploaded to a public test Cloudflare bucket account. To access the backup file use the public URL
https://pub-daddb16dc28841779b83690f75eb5c57.r2.dev/[backup file]
i.e.: https://pub-daddb16dc28841779b83690f75eb5c57.r2.dev/backup-20240905204113.tar.bz2