Redpanda

Redpanda is a streaming platform for mission critical workloads. Kafka® compatible, No Zookeeper®, no JVM, and no code changes required. Use all your favorite open source tooling - 10x faster.

We are building a real-time streaming engine for modern applications - from the enterprise to the solo dev prototyping a react application on her laptop. We go beyond the Kafka protocol, into the future of streaming with inline WASM transforms and geo-replicated hierarchical storage. A new platform that scales with you from the smallest projects to petabytes of data distributed across the globe.

Community

Slack is the main way the community interacts with one another in real time :)

Github Discussion is preferred for longer, async, thoughtful discussions

GitHub Issues is reserved only for actual issues. Please use the mailing list for discussions.

Code of conduct code of conduct for the community

Contributing docs

Getting Started

Prebuilt Packages

We recommend using our free & prebuilt stable releases below.

On MacOS

Simply download our rpk binary here. We require Docker on MacOS

brew install redpanda-data/tap/redpanda && rpk container start

On Debian/Ubuntu

curl -1sLf \
  'https://dl.redpanda.com/nzc4ZYQK3WRGd9sy/redpanda/cfg/setup/bash.deb.sh' \
  | sudo -E bash
  
sudo apt-get install redpanda

On Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://dl.redpanda.com/nzc4ZYQK3WRGd9sy/redpanda/cfg/setup/bash.rpm.sh' \
  | sudo -E bash
  
sudo yum install redpanda

On Other Linux

To install from a .tar.gz archive, download the file and extract it into /opt/redpanda.

For amd64:

curl -LO \
  https://dl.redpanda.com/nzc4ZYQK3WRGd9sy/redpanda/raw/names/redpanda-amd64/versions/22.3.3/redpanda-22.3.3-amd64.tar.gz

For arm64:

curl -LO \
  https://dl.redpanda.com/nzc4ZYQK3WRGd9sy/redpanda/raw/names/redpanda-arm64/versions/22.3.3/redpanda-22.3.3-arm64.tar.gz

Replace 22.3.3 with the appropriate version you are trying to download.

GitHub Actions

    - name: start redpanda
      uses: redpanda-data/github-action@v0.1.3
      with:
        version: "latest"

Now you should be able to connect to redpanda (kafka-api) running at localhost:9092

Build Manually

We provide a very simple build system that uses your system libraries. We recommend users leverage our pre-built stable releases which are vetted, tested, and reproducible with exact versions of the entire transitive dependency graph, including exact compilers all built from source. The only thing we do not build yet is the Linux Kernel, but soon!

For hackers, here is the short and sweet:

sudo ./install-dependencies.sh && CC=clang CXX=clang++ ./build.sh

For quicker dev setup, we provide a docker image with the toolchain installed.

Release candidate builds

We create a release candidate (RC) build when we get close to a new release and publish these to make new features available for testing. RC builds are not recommended for production use.

RC releases on Debian/Ubuntu

curl -1sLf \
  'https://dl.redpanda.com/E4xN1tVe3Xy60GTx/redpanda-unstable/setup.deb.sh' \
  | sudo -E bash

sudo apt-get install redpanda

RC releases on Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://dl.redpanda.com/E4xN1tVe3Xy60GTx/redpanda-unstable/setup.rpm.sh' \
  | sudo -E bash

sudo yum install redpanda

RC releases on Docker

This is an example with the v22.1.1-rc1 version prior to the 22.1.1 release.

docker pull docker.redpanda.com/vectorized/redpanda-unstable:v22.1.1-rc1