Skip to content

cschellenbach/kafka-backup

 
 

Repository files navigation

Kafka Backup

Kafka Backup is a tool to back up and restore your Kafka data including all (configurable) topic data and especially also consumer group offsets. To the best of our knowledge, Kafka Backup is the only viable solution to take a cold backup of your Kafka data and restore it correctly.

Backing up Kafka is not trivial. Apart from kafka-backup there is (to the best of our knowledge) no reliable and data-saving way to backup data from Kafka that also ensures the backup and restore of consumer offsets.

It is architected as two connectors for Kafka Connect: A sink connector (backing data up) and a source connector (restoring data).

Currently kafka-backup supports backup and restore to/from the file system.

Maturity of the project

  • Very early stage
  • There are some sucessful tests
  • Seems to work overall
  • There will be definitely breaking changes in the near future
  • Documentation is coming!
  • More tests are coming!

Documentation

License

This project is licensed under the Apache License Version 2.0 (see LICENSE).

About

Backup and Restore for Apache Kafka

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 78.2%
  • Shell 16.3%
  • Python 4.5%
  • Dockerfile 1.0%