Enable compactor and alertmanager in target all

[SungJin1212]

What this PR does:
Enable compactor and alertmanager in target all.
Which issue(s) this PR fixes:
Fixes #6098

Checklist

• Tests updated
• Documentation added
• CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

[SungJin1212]

@friedrichg
Could you please take a look?

[SungJin1212]

@friedrichg
I fixing the e2e test now!
In many e2e tests, Alertmanager is not necessary. But, because SingleBinary contains Alertmanager, unnecessary code would be added. How should I handle this?

[friedrichg]

Suggested change

	err := externalURL.Set("http://localhost/api/prom")
	err := externalURL.Set("http://localhost/alertmanager")

it's more appropriate

[friedrichg]

I think you can fix most integration tests adding the following snippet to the yamls in docs/configuration

alertmanager:
  external_url: http://localhost/alertmanager

alertmanager_storage:
  backend: local

or something similar

[friedrichg]

You didn't do what I suggested, but that is ok. You solved the problem.
The getting-started is not used in the docs anymore, so more work is needed there. Not to be done in this PR, for sure.

[SungJin1212]

@friedrichg
Thank you for the review and suggestion :)

[SungJin1212]

@CharlieTLe
Could you please take a look?

[yeya24]

I think this change breaks something but I am not sure why it is not captured by tests.

For example, it failed to run Cortex with provided example config file https://github.com/cortexproject/cortex/blob/master/docs/configuration/single-process-config-blocks-local.yaml because the config file misses alertmanager storage configurations

[SungJin1212]

@yeya24
I added alertmanager storage configs in this way.

configOverrides := map[string]string{
		// alert manager
		"-alertmanager.web.external-url":   "http://localhost/alertmanager",
		"-alertmanager-storage.backend":    "local",
		"-alertmanager-storage.local.path": filepath.Join(e2e.ContainerSharedDir, "alertmanager_configs"),
}
	
require.NoError(t, copyFileToSharedDir(s, "docs/configuration/single-process-config-blocks-local.yaml", cortexConfigFile))

cortex1 := e2ecortex.NewSingleBinaryWithConfigFile("cortex-1", cortexConfigFile, configOverrides, "", 9009, 9095)

[yeya24]

I see. @SungJin1212 Can we please fix the config file as well?
I have a user reporting to me that they failed to use the existing config after upgrading Cortex

[SungJin1212]

@yeya24
Sure!

[SungJin1212]

@yeya24
I make a PR. #6274