Compactor: add per tenant compaction delete enabled flag (#6410)

[MichelHollands]

• Add per tenant compaction delete enabled flag

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Remove changes in wrong place

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Add compactor deletion enabled field

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Use limit in compactor

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Use http middleware and add test

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Fix lint issue

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Add changelog

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Revert to default setting if no override

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Add default value command line option

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Update the docs

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Enable access to deletion API for integration test

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Rename flag to allow_deletes

Signed-off-by: Michel Hollands michel.hollands@grafana.com

• Update per review comments

Signed-off-by: Michel Hollands michel.hollands@grafana.com
(cherry picked from commit b4e6c59)

What this PR does / why we need it:

Which issue(s) this PR fixes:
Fixes #

Special notes for your reviewer:

Checklist

• Documentation added
• Tests updated
• Is this an important fix or new feature? Add an entry in the CHANGELOG.md.
• Changes that require user attention or interaction to upgrade are documented in docs/sources/upgrading/_index.md

[grafanabot]

./tools/diff_coverage.sh ../loki-main/test_results.txt test_results.txt ingester,distributor,querier,querier/queryrange,iter,storage,chunkenc,logql,loki

Change in test coverage per package. Green indicates 0 or positive change, red indicates that test coverage for a package fell.

+           ingester	0.4%
+        distributor	0.3%
-            querier	-0.3%
- querier/queryrange	-0.1%
+               iter	0%
+            storage	0%
+           chunkenc	0%
+              logql	0.2%
-               loki	-1.4%

[grafanabot]

./tools/diff_coverage.sh ../loki-main/test_results.txt test_results.txt ingester,distributor,querier,querier/queryrange,iter,storage,chunkenc,logql,loki

Change in test coverage per package. Green indicates 0 or positive change, red indicates that test coverage for a package fell.

+           ingester	0.4%
-        distributor	-0.3%
-            querier	-0.3%
- querier/queryrange	-0.1%
+               iter	0%
+            storage	0%
+           chunkenc	0%
+              logql	0.2%
-               loki	-0.7%