Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] develop from IQSS:develop #643

Open
wants to merge 1,539 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1539 commits
Select commit Hold shift + click to select a range
9a580f8
add wait to async export call
stevenwinship Nov 18, 2024
a04cdab
add wait to async export call
stevenwinship Nov 18, 2024
eef0d22
more incremental changes #10977
landreev Nov 18, 2024
2b22f9f
bugfix: metadataFragment.xhtml
ffritze Oct 23, 2024
26365bd
added docu for the fix
ffritze Nov 19, 2024
c269d3c
Merge branch 'develop' of github.com:IQSS/dataverse into 10959-bearer…
GPortas Nov 19, 2024
73c4079
Changed: simpler statement in auth.rst
GPortas Nov 19, 2024
f99732b
Changed: doc tweak in auth.rst
GPortas Nov 19, 2024
dbfe40d
Refactor: registerOidcUserCommand Bundle strings
GPortas Nov 19, 2024
54677ce
file detection using first few bytes disabled on direct upload
pdurbin Nov 19, 2024
a426101
revert v4.1.7 to v4 (latest)
stevenwinship Nov 19, 2024
42d00d1
Merge pull request #10837 from Recherche-Data-Gouv/harvest_exclude_in…
ofahimIQSS Nov 19, 2024
89b8a1c
Update doc/sphinx-guides/source/api/native-api.rst
landreev Nov 19, 2024
be0979d
Update doc/sphinx-guides/source/api/native-api.rst
landreev Nov 19, 2024
813063e
Update doc/sphinx-guides/source/developers/big-data-support.rst
landreev Nov 19, 2024
e5f8415
Update doc/sphinx-guides/source/api/native-api.rst
pdurbin Nov 19, 2024
1080e51
Merge branch 'develop' into 10193_Shibboleth_SELinux #10193
pdurbin Nov 19, 2024
dcb2f7d
we no longer show the shibboleth.te file on the Shib page #10193
pdurbin Nov 19, 2024
804d284
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 19, 2024
a62193c
Update doc/sphinx-guides/source/api/native-api.rst
stevenwinship Nov 19, 2024
d0df4f0
Update doc/sphinx-guides/source/api/native-api.rst
stevenwinship Nov 19, 2024
a1d1030
Update doc/sphinx-guides/source/api/native-api.rst
stevenwinship Nov 19, 2024
e433ee2
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 19, 2024
e4751c5
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 19, 2024
456f9f6
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 19, 2024
9b15681
Update src/main/java/edu/harvard/iq/dataverse/api/Admin.java
stevenwinship Nov 19, 2024
2586c33
fix camelcase for datasetIdentifierList
stevenwinship Nov 19, 2024
abfc738
fix camelcase for datasetIdentifierList
stevenwinship Nov 19, 2024
7f1c2d9
Merge branch 'develop' into 8184-preview-url-changes
sekmiller Nov 19, 2024
b812173
Merge pull request #10118 from QualitativeDataRepository/IQSS/10117-c…
ofahimIQSS Nov 19, 2024
c0c6b08
Merge pull request #11022 from IQSS/10661-guestbook-email-field-not-v…
ofahimIQSS Nov 19, 2024
b72a9bd
Merge pull request #10997 from IQSS/10993-stop-using-action-v3
ofahimIQSS Nov 19, 2024
8b6737f
Merge pull request #10818 from GlobalDataverseCommunityConsortium/IQS…
ofahimIQSS Nov 19, 2024
66abe87
Merge pull request #10199 from IQSS/10193_Shibboleth_SELinux
ofahimIQSS Nov 19, 2024
6d0afad
Merge pull request #11033 from IQSS/11032-async-datasetit-test-failure
ofahimIQSS Nov 19, 2024
c814ee7
Merge pull request #11035 from IQSS/s3-file-detect
ofahimIQSS Nov 19, 2024
d77ff0d
better formatting for saved search docs #10893
pdurbin Nov 19, 2024
18db323
#8184 fix typo
sekmiller Nov 19, 2024
79c9ebe
Merge branch 'develop' into 8184-preview-url-changes
sekmiller Nov 19, 2024
462613a
Merge remote-tracking branch 'IQSS/develop' into IQSS/7632_exclude_pa…
qqmyers Nov 19, 2024
abc9c81
another entry from QDR
qqmyers Nov 19, 2024
32b7d32
#8184 update refresh delete popup
sekmiller Nov 19, 2024
b64addc
reformat json output
stevenwinship Nov 19, 2024
e89f1ca
reformat json output
stevenwinship Nov 19, 2024
7e9aae9
reformat json output
stevenwinship Nov 19, 2024
11cbe85
reformat json output
stevenwinship Nov 19, 2024
6293787
a quick bug fix; changed verbose logging to .fine. #10977
landreev Nov 19, 2024
3eec366
adding directory label to json and changing camelCase
stevenwinship Nov 19, 2024
714b0f2
removed entry from changelog.rst as requested
ffritze Nov 20, 2024
7495364
Merge branch 'develop' of github.com:IQSS/dataverse into 10959-bearer…
GPortas Nov 20, 2024
dd4b4d7
Merge pull request #1 from IQSS/10739-exportFormats
julian-schneider Nov 20, 2024
6a033df
Merge branch 'develop' into expose-export-formats
julian-schneider Nov 20, 2024
4ae119c
Changed: throwing an error when registering an OIDC user and attempti…
GPortas Nov 20, 2024
335e40a
Changed: doc tweak for api-bearer-auth-json-claims
GPortas Nov 20, 2024
48d04e8
Add PR number to doc/release-notes/expose-export-formats.md
julian-schneider Nov 20, 2024
4ca6070
Refactor: using OAuth2UserRecord instead of OIDCUserInfo
GPortas Nov 20, 2024
07794f3
Removed: unused OIDCUserInfo
GPortas Nov 20, 2024
7d88c8e
Added: release notes for #10959
GPortas Nov 20, 2024
f3b72c6
Update expected JSON for api/info/exportFormats IT Test
julian-schneider Nov 20, 2024
26e8574
tabs to spaces
stevenwinship Nov 20, 2024
a79015f
#11037 limit beta testing deployments to one concurrent action at a time
Nov 20, 2024
2db26b2
add pid
stevenwinship Nov 20, 2024
2c5aca8
fix typos
stevenwinship Nov 20, 2024
3c67a79
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 20, 2024
58d3235
Update doc/release-notes/220-harvard-edu-audit-files.md
stevenwinship Nov 20, 2024
ae58595
Removed: duplicated release notes doc
GPortas Nov 20, 2024
a1f0572
added a configurable batch size limit for when to apply the single fi…
landreev Nov 20, 2024
50b752a
fix typos
stevenwinship Nov 20, 2024
536c1bf
release note #10977
landreev Nov 20, 2024
617b13a
configuration guide entry #10977
landreev Nov 20, 2024
e67bc6e
Merge branch 'develop' into 10977-globus-filesize-lookup
landreev Nov 20, 2024
558577e
Merge branch 'develop' into 10888-add-api-for-comparing-dataset-versions
stevenwinship Nov 20, 2024
f360b91
Changed: checking when claim is blank in the provider in RegisterOIDC…
GPortas Nov 21, 2024
16f8e04
Added: validate user DTO has no claims when feature flag is disabled
GPortas Nov 21, 2024
cc99a8b
Added: test case to RegisterOIDCUserCommandTest for blank claim values
GPortas Nov 21, 2024
e487241
Changed: docs and release note tweak for input levels
GPortas Nov 21, 2024
c28ece0
Merge branch 'develop' of github.com:IQSS/dataverse into 11018-update…
GPortas Nov 21, 2024
c7da932
Added: doc tweak related to excluding metadataBlocks in updateDataverse
GPortas Nov 21, 2024
b63b1ff
Added: doc tweak explaining metadataBlocks is optional in updateDatav…
GPortas Nov 21, 2024
7a15950
Merge branch 'develop' into 7239-mydata-results-by-username
stevenwinship Nov 21, 2024
9edf1ea
Merge pull request #10961 from IQSS/8184-preview-url-changes
ofahimIQSS Nov 21, 2024
88e4276
Merge pull request #10980 from IQSS/7239-mydata-results-by-username
ofahimIQSS Nov 21, 2024
a159204
Merge pull request #11029 from IQSS/10931-making-releases2
sekmiller Nov 22, 2024
975907f
Merge pull request #10678 from bencomp/fix/assert-true-false
ofahimIQSS Nov 22, 2024
ffcc65c
Merge pull request #11019 from Recherche-Data-Gouv/10893-improvements…
ofahimIQSS Nov 22, 2024
a3a11a4
Merge pull request #10945 from IQSS/10888-add-api-for-comparing-datas…
ofahimIQSS Nov 22, 2024
e32cfd8
Merge pull request #10794 from GlobalDataverseCommunityConsortium/IQS…
ofahimIQSS Nov 22, 2024
b8e4758
Merge pull request #10739 from julian-schneider/expose-export-formats
ofahimIQSS Nov 22, 2024
f95c1a0
Merge pull request #10598 from Recherche-Data-Gouv/8941-adding-fileCo…
ofahimIQSS Nov 22, 2024
4853f41
Text changes to address #11046
qqmyers Nov 22, 2024
4449679
quick draft implementation of addressing issue 1. from #10909.
landreev Oct 21, 2024
2656ccd
Adding the new client options to the json printer and parser #10909
landreev Oct 29, 2024
5c043cd
we DO want to include the persistent id in the search cards for all h…
landreev Nov 1, 2024
b7efee0
a flyway script for the "use the oai id as the pid" harvesting client…
landreev Nov 23, 2024
eca0389
removed the part of the cherry-picked commit that I'm not going to ne…
landreev Nov 23, 2024
2911417
removed pieces of another cherry-picked commit not needed in this bra…
landreev Nov 23, 2024
0967b7a
A "hybrid" implementation of the support for using OAI identifiers fo…
landreev Nov 23, 2024
00943e1
guide entry
landreev Nov 25, 2024
cc7fb45
release note.
landreev Nov 25, 2024
d6fc240
json files for the new tests (from PR #11010 by @stevenferey)
landreev Nov 25, 2024
86b2260
tests for selecting persistent ids in the GenericImportService (from …
landreev Nov 25, 2024
d7cb845
actions/checkout 2->3
qqmyers Nov 20, 2024
6069815
actions @v3 -> @v4
qqmyers Nov 25, 2024
115c88e
Update doc/release-notes/11049-oai-identifiers-as-pids.md
landreev Nov 25, 2024
a295cc4
Update doc/sphinx-guides/source/api/native-api.rst
landreev Nov 25, 2024
3c46287
reverted the flyway script back to its original state (a newline was …
landreev Nov 25, 2024
8a361be
another cherry-picked commit not needed in this branch.
landreev Nov 25, 2024
5142643
more @3->@4
qqmyers Nov 25, 2024
f0e1916
#11044 refresh facet array
sekmiller Nov 25, 2024
e8093c6
Per review feedback, made it impossible to supply the file sizes via …
landreev Nov 25, 2024
3cd9a82
We do support 0-size files! #10977
landreev Nov 25, 2024
644a524
added a bunch of globus-related entries that were missing from the bu…
landreev Nov 25, 2024
28e25ea
one more missing notification entry in the bundle #10977
landreev Nov 25, 2024
1325cee
This should make the filesize setting logic less confusing potentiall…
landreev Nov 26, 2024
321de7c
there's no need to slap the "incomplete metadata" label on harvested …
landreev Nov 26, 2024
1c17c3e
Merge pull request #11026 from IQSS/11018-update-dataverse-fix
ofahimIQSS Nov 26, 2024
51e1ad7
#11044 reset input levels prior to update
sekmiller Nov 26, 2024
5bfc435
Update from Dev
sekmiller Nov 26, 2024
8fd500d
#11044 reset after merge conflict
sekmiller Nov 26, 2024
1066b1e
fix search files to return latest published citation
stevenwinship Nov 26, 2024
50fa86b
Merge remote-tracking branch 'upstream/develop' into 11037_deploy_bet…
Nov 26, 2024
2328046
#11044 code cleanup
sekmiller Nov 26, 2024
ea97785
#11044 more cleanup
sekmiller Nov 26, 2024
40fe665
a typo in search include fragment
landreev Nov 26, 2024
e914b62
check the bugfix
ffritze Nov 27, 2024
bcb441e
Merge pull request #11039 from uncch-rdmc/11037_deploy_beta_concurrency
ofahimIQSS Nov 27, 2024
3c427c1
Merge pull request #11049 from IQSS/10909-oai-identifiers-as-pids
ofahimIQSS Nov 27, 2024
5e3616e
Update appendix.rst
jggautier Nov 27, 2024
3d50ba8
typo
qqmyers Nov 27, 2024
4624bb6
Merge pull request #11055 from IQSS/11028-remove-broken-metadata-bloc…
qqmyers Nov 28, 2024
301e918
Merge branch 'develop' into 11044-edit-facet-bug
sekmiller Dec 2, 2024
a192c17
fix release note
stevenwinship Dec 2, 2024
e06e1d2
fix api doc
stevenwinship Dec 2, 2024
8c79f67
fix api doc
stevenwinship Dec 2, 2024
5d7d942
Merge pull request #11016 from IQSS/220-audit-physical-files
ofahimIQSS Dec 2, 2024
f5f5cd2
Merge pull request #11040 from IQSS/10977-globus-filesize-lookup
ofahimIQSS Dec 2, 2024
353da1d
chore: update docs
g-saracca Dec 3, 2024
1b5a1ea
Merge pull request #10696 from erodde/10688_whitespace_trimming
ofahimIQSS Dec 3, 2024
1af22b5
Merge branch 'develop' into 11044-edit-facet-bug
sekmiller Dec 3, 2024
ca95ad8
#11044 fix failing tests
sekmiller Dec 3, 2024
a36db2d
Merge pull request #11052 from IQSS/11044-edit-facet-bug
ofahimIQSS Dec 4, 2024
04e9eba
comment out /dev/lang to prevent verbose logging #11043
pdurbin Dec 4, 2024
d9214a3
reword #11043
pdurbin Dec 4, 2024
f9fd4c8
Terms of use
lubitchv Dec 4, 2024
82dad99
Merge pull request #11063 from IQSS/11043-lang
ofahimIQSS Dec 5, 2024
b87fdf7
#10952 create doc/outline
sekmiller Dec 2, 2024
eae7478
start adding features, bug fixes, etc to notes #10952
pdurbin Dec 3, 2024
e520a9a
add more to notes #10952
pdurbin Dec 3, 2024
3e69dd1
more features, etc #10952
pdurbin Dec 4, 2024
65fbd27
more content #10952
pdurbin Dec 4, 2024
aa56e62
more content #10952
pdurbin Dec 4, 2024
8f8bce8
more content #10952
pdurbin Dec 5, 2024
c331d89
added last of the snippets (for now) #10952
pdurbin Dec 5, 2024
cabf738
fix URLs #10952
pdurbin Dec 5, 2024
8d1b4a1
add highlights and rework content a bit #10952
pdurbin Dec 5, 2024
7503ea3
add Relation Type bug (no release note snippet) #10952 #10926
pdurbin Dec 5, 2024
77834a2
demo docker feature, fix heading #10952
pdurbin Dec 5, 2024
8ce2909
tweaks #10952
pdurbin Dec 5, 2024
7885fa2
typo
pdurbin Dec 5, 2024
48d77d3
spelling
pdurbin Dec 5, 2024
5e21b80
remove trailing `
pdurbin Dec 6, 2024
6cf718e
tweak deploy step, remove mdb update and schema.xml steps (not needed…
pdurbin Dec 6, 2024
a66c085
more sudo #10952
pdurbin Dec 6, 2024
0a82885
whoops, we do need to update schema.xml #10952
pdurbin Dec 6, 2024
83c22b2
yet more sudo and call out non-root user #10952
pdurbin Dec 6, 2024
c1df8c5
tweaks #10952
pdurbin Dec 6, 2024
f19794b
changes made in #9665 belong in 6.5 changelog, not 6.4
pdurbin Dec 6, 2024
38cff71
reword and link to endpoint docs #9665
pdurbin Dec 6, 2024
bafb91d
update query as native
qqmyers Dec 6, 2024
7b2caae
Import DDI with license
lubitchv Dec 6, 2024
deb2d88
many more tweaks #10952
pdurbin Dec 6, 2024
4c28092
import DTO
lubitchv Dec 6, 2024
7611a21
update how we use sudo #10952
pdurbin Dec 6, 2024
2d0c584
typo
pdurbin Dec 6, 2024
1859aeb
uri
lubitchv Dec 6, 2024
15e9fe9
Merge pull request #11070 from IQSS/9665-changelog
ofahimIQSS Dec 6, 2024
d3be336
cvoc fix, status fix, lower per-file logging
qqmyers Dec 6, 2024
dd64ebb
ever more sudo #10952
pdurbin Dec 9, 2024
98d68c9
explain how to download the war file before deploying #10952
pdurbin Dec 9, 2024
48246a6
note that Solr dir can differ #10952
pdurbin Dec 9, 2024
03b06fb
Merge branch 'develop' of github.com:IQSS/dataverse into 10959-bearer…
GPortas Dec 9, 2024
9a4252b
#11076 test session user perms
sekmiller Dec 10, 2024
ab7c90e
typo
pdurbin Dec 10, 2024
63ff790
typo
pdurbin Dec 10, 2024
206d8f0
Merge pull request #11072 from QualitativeDataRepository/IQSS/11069-f…
ofahimIQSS Dec 10, 2024
e733a2b
rely on the path based checks rather than looking at [0] in the array
qqmyers Dec 10, 2024
853ced6
#11076 refresh delete popup
sekmiller Dec 10, 2024
452cca4
word choice
pdurbin Dec 10, 2024
6e3a250
Merge pull request #11080 from IQSS/11076-access-previewUrl-with-perms
ofahimIQSS Dec 10, 2024
2dd997c
include total_count_per_object_type in search response
stevenwinship Dec 10, 2024
f581499
update serch api doc
stevenwinship Dec 10, 2024
5f1ea6b
update serch api doc
stevenwinship Dec 10, 2024
3be6369
update search api doc
stevenwinship Dec 10, 2024
9cc3f7f
update search api doc
stevenwinship Dec 10, 2024
600fe58
Added: feature flag API_BEARER_AUTH_HANDLE_TOS_ACCEPTANCE_IN_IDP to F…
GPortas Dec 11, 2024
f9283e8
Merge branch 'develop' of github.com:IQSS/dataverse into 10959-bearer…
GPortas Dec 11, 2024
fac0dc3
Added: managing API_BEARER_AUTH_HANDLE_TOS_ACCEPTANCE_IN_IDP feature …
GPortas Dec 11, 2024
4c803d2
keep status checks
qqmyers Dec 11, 2024
0a8f8c5
Merge pull request #11081 from GlobalDataverseCommunityConsortium/Fix…
ofahimIQSS Dec 11, 2024
ce6a99a
#10952 add not about breadcrumbs in Anon Preview URL
sekmiller Dec 11, 2024
929128b
#10952 reword
sekmiller Dec 11, 2024
a0508d1
add link to #11085
pdurbin Dec 11, 2024
73cc914
Merge pull request #11034 from TIK-NFL/display_overview_fix
ofahimIQSS Dec 11, 2024
b7b0d0f
Merge branch 'develop' into 10952-release-notes #10952
pdurbin Dec 11, 2024
fe13a43
add cvoc overview fix #10952
pdurbin Dec 11, 2024
2de57e1
remove "in place" from Solr reindex step #10952
pdurbin Dec 11, 2024
5499549
Merge pull request #11067 from IQSS/10952-release-notes
ofahimIQSS Dec 11, 2024
2c08be4
bump version to 6.5 #10954
pdurbin Dec 11, 2024
d9c03e0
make change for proper tagging of images #10954
pdurbin Dec 11, 2024
ceb1974
Merge branch 'develop' of github.com:IQSS/dataverse into 10959-bearer…
GPortas Dec 12, 2024
628746c
Changed: updated auth.rst docs with api-bearer-auth-handle-tos-accept…
GPortas Dec 12, 2024
4227eff
Changed: updated config.rst docs with api-bearer-auth-handle-tos-acce…
GPortas Dec 12, 2024
abf6994
Changed: updated release notes
GPortas Dec 12, 2024
a4d0127
Merge pull request #11091 from IQSS/10954-bump-to-6.5
ofahimIQSS Dec 12, 2024
d522815
Merge remote-tracking branch 'IQSS/develop' into Update_action/checkout
qqmyers Dec 12, 2024
a5caa76
Merge remote-tracking branch 'IQSS/develop' into IQSS/11046
qqmyers Dec 12, 2024
ffb593e
Update pom.xml
sekmiller Dec 12, 2024
ac6cfe0
Merge remote-tracking branch 'IQSS/develop' into IQSS/7632_exclude_pa…
qqmyers Dec 12, 2024
069275e
Merge branch 'IQSS/7632_exclude_packages' of https://github.com/Globa…
qqmyers Dec 12, 2024
af10ae9
fix type counts to include all results and not just the pages worth
stevenwinship Dec 13, 2024
02ef448
remove unused include
stevenwinship Dec 13, 2024
e3b5795
Merge pull request #11094 from IQSS/prepare-next-iteration
ofahimIQSS Dec 13, 2024
1feeb22
Merge branch 'IQSS:develop' into 9871-termsofuse_license
lubitchv Dec 13, 2024
32de244
test
lubitchv Dec 13, 2024
b2fb0cc
extened search api
stevenwinship Dec 16, 2024
ea79a8f
fix style
stevenwinship Dec 16, 2024
4d28d0d
fix style
stevenwinship Dec 16, 2024
b74eb1a
Merge branch 'develop' into 11065-extend-search-api-to-include-type-c…
stevenwinship Dec 16, 2024
01b6762
Merge branch 'develop' into master_json_fix #10764
pdurbin Dec 16, 2024
3fd62f6
make changelog for 6.6, reword #10764
pdurbin Dec 16, 2024
aad328e
adding release notes
stevenwinship Dec 16, 2024
3d9da80
change schema.xml
stevenwinship Dec 16, 2024
ec4c888
Merge pull request #9251 from carlsonp/dependabot-github-actions
ofahimIQSS Dec 16, 2024
135d9cb
adding tabularTags
stevenwinship Dec 16, 2024
cd3f0ef
Merge pull request #24 from IQSS/10764-updates
ffritze Dec 17, 2024
b2e271a
fix the tests: DataversesIT and MetadataBlocksIT
ffritze Dec 18, 2024
957adab
removed the tab
ffritze Dec 18, 2024
ed391eb
Merge pull request #7636 from GlobalDataverseCommunityConsortium/IQSS…
ofahimIQSS Dec 18, 2024
1e47153
#11027 update release notes for schema.xml
sekmiller Dec 18, 2024
ec77873
Change per request
qqmyers Dec 18, 2024
b329450
Merge pull request #10972 from IQSS/10959-bearer-token-auth-ext
ofahimIQSS Dec 19, 2024
bee3cdf
Merge pull request #11082 from IQSS/11065-extend-search-api-to-includ…
ofahimIQSS Dec 19, 2024
77caada
Merge pull request #11097 from IQSS/11027-extend-datasets-files-from-…
ofahimIQSS Dec 19, 2024
637c216
Merge pull request #11048 from GlobalDataverseCommunityConsortium/IQS…
ofahimIQSS Dec 19, 2024
2ae639d
Merge pull request #10764 from TIK-NFL/master_json_fix
ofahimIQSS Dec 20, 2024
f7aabc8
Merge pull request #11051 from IQSS/10735-search-dataset-name-and-dat…
ofahimIQSS Dec 20, 2024
75ba6d6
Merge pull request #11071 from lubitchv/9871-termsofuse_license
ofahimIQSS Dec 20, 2024
09d0b83
Merge pull request #11050 from QualitativeDataRepository/Update_actio…
ofahimIQSS Dec 20, 2024
b9f9964
Bump actions/cache from 2 to 4
dependabot[bot] Dec 20, 2024
ce3e77c
Merge pull request #11102 from IQSS/dependabot/github_actions/actions…
ofahimIQSS Dec 20, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
4 changes: 2 additions & 2 deletions .env
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
APP_IMAGE=gdcc/dataverse:unstable
POSTGRES_VERSION=16
POSTGRES_VERSION=17
DATAVERSE_DB_USER=dataverse
SOLR_VERSION=9.3.0
SKIP_DEPLOY=0
SKIP_DEPLOY=0
7 changes: 5 additions & 2 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ Thank you for contributing to the Dataverse Project through the creation of a bu
WARNING: If this is a security issue it should be reported privately to security@dataverse.org

More information on bug issues and contributions can be found in the "Contributing to Dataverse" page:
https://github.com/IQSS/dataverse/blob/develop/CONTRIBUTING.md#bug-reportsissues
https://guides.dataverse.org/en/latest/contributor/index.html

Please fill out as much of the template as you can.
Start below this comment section.
Expand Down Expand Up @@ -44,7 +44,6 @@ Start below this comment section.
**Any related open or closed issues to this bug report?**



**Screenshots:**

No matter the issue, screenshots are always welcome.
Expand All @@ -53,3 +52,7 @@ To add a screenshot, please use one of the following formats and/or methods desc

* https://help.github.com/en/articles/file-attachments-on-issues-and-pull-requests
*


**Are you thinking about creating a pull request for this issue?**
Help is always welcome, is this bug something you or your organization plan to fix?
7 changes: 5 additions & 2 deletions .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
name: Feature request
about: Suggest an idea or new feature for the Dataverse software!
title: 'Feature Request/Idea:'
title: 'Feature Request:'
labels: 'Type: Feature'
assignees: ''

Expand All @@ -11,7 +11,7 @@ assignees: ''
Thank you for contributing to the Dataverse Project through the creation of a feature request!

More information on ideas/feature requests and contributions can be found in the "Contributing to Dataverse" page:
https://github.com/IQSS/dataverse/blob/develop/CONTRIBUTING.md#ideasfeature-requests
https://guides.dataverse.org/en/latest/contributor/index.html

Please fill out as much of the template as you can.
Start below this comment section.
Expand All @@ -34,3 +34,6 @@ Start below this comment section.


**Any open or closed issues related to this feature request?**

**Are you thinking about creating a pull request for this feature?**
Help is always welcome, is this feature something you or your organization plan to implement?
40 changes: 40 additions & 0 deletions .github/ISSUE_TEMPLATE/idea_proposal.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
---
name: Idea proposal
about: Propose a new idea for discussion to improve the Dataverse software!
title: 'Suggestion:'
labels: 'Type: Suggestion'
assignees: ''

---

<!--
Thank you for contributing to the Dataverse Project through the creation of a feature request!

More information on ideas/feature requests and contributions can be found in the "Contributing to Dataverse" page:
https://guides.dataverse.org/en/latest/contributor/index.html

Please fill out as much of the template as you can.
Start below this comment section.
-->

**Overview of the Suggestion**


**What kind of user is the suggestion intended for?**
(Example users roles: API User, Curator, Depositor, Guest, Superuser, Sysadmin)


**What inspired this idea?**


**What existing behavior do you want changed?**


**Any brand new behavior do you want to add to Dataverse?**


**Any open or closed issues related to this suggestion?**


**Are you thinking about creating a pull request for this issue?**
Help is always welcome, is this idea something you or your organization plan to implement?
2 changes: 1 addition & 1 deletion .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

**Which issue(s) this PR closes**:

Closes #
- Closes #

**Special notes for your reviewer**:

Expand Down
37 changes: 37 additions & 0 deletions .github/actions/setup-maven/action.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
---
name: "Setup Maven and Caches"
description: "Determine Java version and setup Maven, including necessary caches."
inputs:
git-reference:
description: 'The git reference (branch/tag) to check out'
required: false
default: '${{ github.ref }}'
pom-paths:
description: "List of paths to Maven POM(s) for cache dependency setup"
required: false
default: 'pom.xml'
runs:
using: composite
steps:
- name: Checkout repository
uses: actions/checkout@v4
with:
ref: ${{ inputs.git-reference }}
- name: Determine Java version by reading the Maven property
shell: bash
run: |
echo "JAVA_VERSION=$(grep '<target.java.version>' ${GITHUB_WORKSPACE}/modules/dataverse-parent/pom.xml | cut -f2 -d'>' | cut -f1 -d'<')" | tee -a ${GITHUB_ENV}
- name: Set up JDK ${{ env.JAVA_VERSION }}
id: setup-java
uses: actions/setup-java@v4
with:
java-version: ${{ env.JAVA_VERSION }}
distribution: 'temurin'
cache: 'maven'
cache-dependency-path: ${{ inputs.pom-paths }}
- name: Download common cache on branch cache miss
if: ${{ steps.setup-java.outputs.cache-hit != 'true' }}
uses: actions/cache/restore@v4
with:
key: dataverse-maven-cache
path: ~/.m2/repository
11 changes: 11 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
# Set update schedule for GitHub Actions
# https://docs.github.com/en/code-security/supply-chain-security/keeping-your-dependencies-updated-automatically/keeping-your-actions-up-to-date-with-dependabot

version: 2
updates:

- package-ecosystem: "github-actions"
directory: "/"
schedule:
# Check for updates to GitHub Actions daily
interval: "daily"
32 changes: 32 additions & 0 deletions .github/workflows/check_property_files.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: "Properties Check"
on:
pull_request:
paths:
- "src/**/*.properties"
- "scripts/api/data/metadatablocks/*"
jobs:
duplicate_keys:
name: Duplicate Keys
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: Run duplicates detection script
shell: bash
run: tests/check_duplicate_properties.sh

metadata_blocks_properties:
name: Metadata Blocks Properties
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: Setup GraalVM + Native Image
uses: graalvm/setup-graalvm@v1
with:
github-token: ${{ secrets.GITHUB_TOKEN }}
java-version: '21'
distribution: 'graalvm-community'
- name: Setup JBang
uses: jbangdev/setup-jbang@main
- name: Run metadata block properties verification script
shell: bash
run: tests/verify_mdb_properties.sh
8 changes: 4 additions & 4 deletions .github/workflows/container_app_pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,14 +20,14 @@ jobs:
if: ${{ github.repository_owner == 'IQSS' }}
steps:
# Checkout the pull request code as when merged
- uses: actions/checkout@v3
- uses: actions/checkout@v4
with:
ref: 'refs/pull/${{ github.event.client_payload.pull_request.number }}/merge'
- uses: actions/setup-java@v3
- uses: actions/setup-java@v4
with:
java-version: "17"
distribution: 'adopt'
- uses: actions/cache@v3
- uses: actions/cache@v4
with:
path: ~/.m2
key: ${{ runner.os }}-m2-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -87,7 +87,7 @@ jobs:
:ship: [See on GHCR](https://github.com/orgs/gdcc/packages/container). Use by referencing with full name as printed above, mind the registry name.

# Leave a note when things have gone sideways
- uses: peter-evans/create-or-update-comment@v3
- uses: peter-evans/create-or-update-comment@v4
if: ${{ failure() }}
with:
issue-number: ${{ github.event.client_payload.pull_request.number }}
Expand Down
47 changes: 30 additions & 17 deletions .github/workflows/container_app_push.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,12 @@ on:
# We are deliberately *not* running on push events here to avoid double runs.
# Instead, push events will trigger from the base image and maven unit tests via workflow_call.
workflow_call:
inputs:
base-image-ref:
type: string
description: "Reference of the base image to build on in full qualified form [<registry>/]<namespace>/<repo>:<tag>"
required: false
default: "gdcc/base:unstable"
pull_request:
branches:
- develop
Expand All @@ -16,7 +22,6 @@ on:

env:
IMAGE_TAG: unstable
BASE_IMAGE_TAG: unstable
REGISTRY: "" # Empty means default to Docker Hub
PLATFORMS: "linux/amd64,linux/arm64"
MASTER_BRANCH_TAG: alpha
Expand All @@ -33,20 +38,24 @@ jobs:
if: ${{ github.repository_owner == 'IQSS' }}

steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Set up JDK
uses: actions/setup-java@v3
- name: Checkout and Setup Maven
uses: IQSS/dataverse/.github/actions/setup-maven@develop
with:
java-version: "17"
distribution: temurin
cache: maven
pom-paths: |
pom.xml
modules/container-configbaker/pom.xml
modules/dataverse-parent/pom.xml

# TODO: Add a filter step here, that avoids building the image if this is a PR and there are other files touched than declared above.
# Use https://github.com/dorny/paths-filter to solve this. This will ensure we do not run this twice if this workflow
# will be triggered by the other workflows already (base image or java changes)
# To become a part of #10618.

- name: Build app and configbaker container image with local architecture and submodules (profile will skip tests)
run: >
mvn -B -f modules/dataverse-parent
-P ct -pl edu.harvard.iq:dataverse -am
$( [[ -n "${{ inputs.base-image-ref }}" ]] && echo "-Dbase.image=${{ inputs.base-image-ref }}" )
install

# TODO: add smoke / integration testing here (add "-Pct -DskipIntegrationTests=false")
Expand All @@ -59,15 +68,15 @@ jobs:
if: ${{ github.event_name != 'pull_request' && github.ref_name == 'develop' && github.repository_owner == 'IQSS' }}
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: peter-evans/dockerhub-description@v3
- uses: actions/checkout@v4
- uses: peter-evans/dockerhub-description@v4
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
repository: gdcc/dataverse
short-description: "Dataverse Application Container Image providing the executable"
readme-filepath: ./src/main/docker/README.md
- uses: peter-evans/dockerhub-description@v3
- uses: peter-evans/dockerhub-description@v4
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
Expand Down Expand Up @@ -106,11 +115,13 @@ jobs:
if: needs.check-secrets.outputs.available == 'true' &&
( github.event_name != 'push' || ( github.event_name == 'push' && contains(fromJSON('["develop", "master"]'), github.ref_name)))
steps:
- uses: actions/checkout@v3
- uses: actions/setup-java@v3
- name: Checkout and Setup Maven
uses: IQSS/dataverse/.github/actions/setup-maven@develop
with:
java-version: "17"
distribution: temurin
pom-paths: |
pom.xml
modules/container-configbaker/pom.xml
modules/dataverse-parent/pom.xml

# Depending on context, we push to different targets. Login accordingly.
- if: github.event_name != 'pull_request'
Expand Down Expand Up @@ -146,11 +157,13 @@ jobs:
run: >
mvn -B -f modules/dataverse-parent
-P ct -pl edu.harvard.iq:dataverse -am
$( [[ -n "${{ inputs.base-image-ref }}" ]] && echo "-Dbase.image=${{ inputs.base-image-ref }}" )
install
- name: Deploy multi-arch application and configbaker container image
run: >
mvn
-Dapp.image.tag=${{ env.IMAGE_TAG }} -Dbase.image.tag=${{ env.BASE_IMAGE_TAG }}
-Dapp.image.tag=${{ env.IMAGE_TAG }}
$( [[ -n "${{ inputs.base-image-ref }}" ]] && echo "-Dbase.image=${{ inputs.base-image-ref }}" )
${{ env.REGISTRY }} -Ddocker.platforms=${{ env.PLATFORMS }}
-P ct deploy

Expand Down
Loading