Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[stable30] Transparent* database sharding #47561

Merged
merged 19 commits into from
Aug 28, 2024
Merged

[stable30] Transparent* database sharding #47561

merged 19 commits into from
Aug 28, 2024

Conversation

backportbot[bot]
Copy link

@backportbot backportbot bot commented Aug 28, 2024 •
edited by artonge
Loading

Backport of #46639

Warning, This backport's changes differ from the original and might be incomplete ⚠️

Todo

  • Review and resolve any conflicts
  • Amend HEAD commit to remove the line stating to skip CI

Learn more about backports at https://docs.nextcloud.com/server/stable/go.php?to=developer-backports.

@backportbot backportbot bot added the 3. to review Waiting for reviews label Aug 28, 2024
@backportbot backportbot bot added this to the Nextcloud 30.0.1 milestone Aug 28, 2024
@artonge artonge force-pushed the backport/46639/stable30 branch 3 times, most recently from 066d5fb to 5b16734 Compare August 28, 2024 10:40
@artonge artonge force-pushed the backport/46639/stable30 branch 2 times, most recently from f1b08fb to 1be67e9 Compare August 28, 2024 12:19
@artonge artonge marked this pull request as ready for review August 28, 2024 12:20
@icewind1991 @artonge
feat: track expected output columns in query builder
8eaddbc 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: don't make ICacheFactory depend on database
b1744e7 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: delay calculating global cache prefix untill a cache is created
8f57d46 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
feat: add option to automatically partition queries by specific tables
4ec53e7 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
feat: implement distributing partitioned queries over multiple shards
82d7eaf 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
test: mark share test cleanup as running across all shards
ecf1cc2 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: only allow pre-defined shards
3e51939 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
test: run sharding tests in ci
22f76fc 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: hint storage id in more places
693ee5e 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: run mimetype repair query across all shards
0e40fa4 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
test: fix share provider tests for sharding
1b6d76a 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: make background scan job compatible with sharding
5500723 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: adjust systemtag orphan cleanup query to work with sharding
ddecae8 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: fix share cleanup for deleted groups with sharding
dc5f0f5 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: implement sharding compatible cleanup for various bits
b264559 
Signed-off-by: Robin Appelman <robin@icewind.nl>
icewind1991 and others added 4 commits August 28, 2024 14:54
@icewind1991 @artonge
fix: make preload custom proterties sharding compatible
57ffbb7 
Signed-off-by: Robin Appelman <robin@icewind.nl>
@icewind1991 @artonge
fix: mark systemconfig value as not being tainted because they are im…
e2bff39 
…plicitly trusted

Signed-off-by: Robin Appelman <robin@icewind.nl>
@artonge
chore: Apply php:cs recommendations
e5a8f99 
Signed-off-by: Louis Chemineau <louis@chmn.me>

[skip ci]
@artonge
fix: Backport to 30
140b36f 
Signed-off-by: Louis Chemineau <louis@chmn.me>
@sorbaugh sorbaugh merged commit f014c52 into stable30 Aug 28, 2024
173 of 174 checks passed