Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bloom-builder: panic: mkdir /tmp/bloom-block-1802389595: read-only file system #14084

Closed
diranged opened this issue Sep 9, 2024 · 0 comments · Fixed by #14128
Closed

bloom-builder: panic: mkdir /tmp/bloom-block-1802389595: read-only file system #14084

diranged opened this issue Sep 9, 2024 · 0 comments · Fixed by #14128

Comments

@diranged
Copy link

diranged commented Sep 9, 2024

Describe the bug

If you get past #14082 - a followup issue looks to be that /tmp is not created for the pod either, causing this error:

panic: mkdir /tmp/bloom-block-1802389595: read-only file system

goroutine 425 [running]:
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*Builder).writerReaderFunc(0x4001404201?)
	/src/loki/pkg/bloombuild/builder/builder.go:524 +0xf0
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*LazyBlockBuilderIterator).Next(0x40014281e0)
	/src/loki/pkg/bloombuild/builder/spec.go:224 +0x270
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*Builder).processTask(0x40011fa200, {0x3c79330, 0x4001244450}, 0x4000b7f720)
	/src/loki/pkg/bloombuild/builder/builder.go:405 +0x1418
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*Builder).builderLoop(0x40011fa200, {0x3c93370, 0x40012ca540})
	/src/loki/pkg/bloombuild/builder/builder.go:242 +0x230
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*Builder).connectAndBuild(0x40011fa200, {0x3c79368, 0x400139e2d0})
	/src/loki/pkg/bloombuild/builder/builder.go:201 +0x288
github.com/grafana/loki/v3/pkg/bloombuild/builder.(*Builder).running(0x40011fa200, {0x3c79368, 0x400139e2d0})
	/src/loki/pkg/bloombuild/builder/builder.go:142 +0xd0
github.com/grafana/dskit/services.(*BasicService).main(0x40013b40a0)
	/src/loki/vendor/github.com/grafana/dskit/services/basic_service.go:193 +0x17c
created by github.com/grafana/dskit/services.(*BasicService).StartAsync.func1 in goroutine 80
	/src/loki/vendor/github.com/grafana/dskit/services/basic_service.go:122 +0xfc
mraboosk pushed a commit to mraboosk/loki that referenced this issue Oct 7, 2024
…na#14128)

* Fix: Do not create bloom Deployment/Statefulset if replicas=0 (fixes grafana#14090)
* Fix: Configure PV claims for bloom gateway and bloom builder correctly (fixes grafana#14082)
* Fix: Configure emphemeral storage for bloom builder working directory (fixes grafana#14084)
* Add required configuration for bloom builder and bloom gateway

---

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant