From 7a864e84c79f524a0162eae1cd024903d068a1db Mon Sep 17 00:00:00 2001 From: qqmyers Date: Mon, 10 Jun 2024 10:36:35 -0400 Subject: [PATCH] Solr: Try Soft Commit on Indexing (#10547) * try soft commit * keep softcommit short to avoid delays in visibility * add test delay for autosoft, make hardcommit 30s like auto setting * add 1-2 second delays in tests for softAutocomplete at 1s * more sleeps * more delays * remove commented out deletes * more commented out code to remove * add 1 sec on failing tests * add missing perm reindex * change waiting * fix index object and add null check for unit test * remove test-specific null check * reindex linking dv * general solr release note * more fixes * revert change - was correct * another sleepforsearch * test adding explicit reindexing * avoid other uses of cache in test that looks for exact counts * Adding longer max sleep, add count param to sleep method * Revert "add missing perm reindex" This reverts commit 317038ae8083e5d421e91c65176df0a806b04011. --- conf/solr/9.3.0/solrconfig.xml | 4 +- doc/release-notes/10547-solr-updates.md | 1 + .../iq/dataverse/search/IndexServiceBean.java | 34 ++++------------- .../search/SolrIndexServiceBean.java | 13 ++----- .../iq/dataverse/api/DataversesIT.java | 2 +- .../edu/harvard/iq/dataverse/api/LinkIT.java | 6 +++ .../harvard/iq/dataverse/api/SearchIT.java | 37 ++++++------------- .../edu/harvard/iq/dataverse/api/UtilIT.java | 19 ++++++++-- .../impl/CreatePrivateUrlCommandTest.java | 16 ++++++++ .../util/cache/CacheFactoryBeanTest.java | 2 + 10 files changed, 66 insertions(+), 68 deletions(-) create mode 100644 doc/release-notes/10547-solr-updates.md diff --git a/conf/solr/9.3.0/solrconfig.xml b/conf/solr/9.3.0/solrconfig.xml index 36ed4f23390..34386375fe1 100644 --- a/conf/solr/9.3.0/solrconfig.xml +++ b/conf/solr/9.3.0/solrconfig.xml @@ -290,7 +290,7 @@ have some sort of hard autoCommit to limit the log size. --> - ${solr.autoCommit.maxTime:15000} + ${solr.autoCommit.maxTime:30000} false @@ -301,7 +301,7 @@ --> - ${solr.autoSoftCommit.maxTime:-1} + ${solr.autoSoftCommit.maxTime:1000}