Existed Prometheus TSDB block importing

[songjiayang]

Is your feature request related to a problem? Please describe.

There are many existed Prometheus instances, when change them to Cortex, how can we query the old Prometheus data?

Describe the solution you'd like
How about adding a API for old Prometheus TSDB block data import.

Describe alternatives you've considered

More like Prometheus backfing solution, but it's local solution and does't support mutiple tenents.

[ilangofman]

It is possible to add Prometheus blocks into Cortex, but some things need to be changed. Mainly, some labels must be added to the meta.json file. The thanosconvert tool can support migrating Prometheus blocks to Cortex as well. That page also describes how the metadata file must be changed.

I think expanding it to an API would be nice and make it more flexible. I think I saw historical block import as part of the last meeting's agenda in the roadmap section, so there might be some discussion happening there.

[yeya24]

It would be nice if we can support uploading Thanos blocks, too. Ideally Prometheus and Thanos blocks are similar, there are some differences on the meta.json file.
In terms of downsampled Thanos blocks, I think we can skip them for now.

[swaingotnochill]

Hi @songjiayang , I found this project in LFX CNCF and interested to work on. I have experience working with Go, but not familiar with Thanos and Prometheus. Is it required to have previous knowledge of Prometheus and Cortex to apply? How can i get started with? Any help is appreciated.

[edith007]

Thanks a lot @alanprot for believing me 🙇🏻 Looking forward to work on this project under LFX mentorship! 🙇🏻

[stale]

This issue has been automatically marked as stale because it has not had any activity in the past 60 days. It will be closed in 15 days if no further activity occurs. Thank you for your contributions.