Skip to content

Latest commit

 

History

History
35 lines (28 loc) · 1.17 KB

README.md

File metadata and controls

35 lines (28 loc) · 1.17 KB
Raw

NiFi Redis Publish / Subscribe processors

The NiFi processor implements producer/consumer (queue) and publisher/subscriber (topic) patterns on top of Redis. Following options are available for now:

  • lpush/rpush/lpop/rpop commands, so Redis lists are used to emulate a queue
  • publish/subscribe commands, so pub/sub pattern are used to emulate a topic

Configuration options:

  • Redis Connection Pool - standard NiFi controller service
  • Queue Mode - xPUSH/xPOP or PUBLISH/SUBSCRIBE mode
  • Channel/Key Name - channel (in case of pubsub mode) or key (for xPUSH/xPOP mode)

How to build and run

Build NAR (NiFi Archive)

mvn install

Copy the NAR into your NiFi directory (usually /opt/nifi/nifi-current/lib).
Restart NiFi.

To run all integration tests use

mvn -P integration-tests verify

Release notes

v 0.0.2

Improved xPUSH operation performance by sending bulk of values per call.
PUBLISH performance stays the same as far as Redis does not accepts nultiple values in the command.

v 0.0.1

First working release

TODO

  • Redis Streams support (now it is tricky to implement because Jedis still does not have streams support)