This project provides a sample solution for implementing a message shovel with Azure Service Bus and Azure Functions. A shovel moves messages from one queue or topic to another queue or topic. There is a great shovel integration for RabbitMQ. For companies which want to decrease operational effort by using PaaS services instead of hosting the shovel solution themselves, this repository is a great start.
How does it work?
The sender sends a message to a service bus queue. The queue triggers an Azure Functions. The Function makes routing decisions based on entries in a routing database (in this case using Azure Redis Cache). The routing database contains all allowed routes. After validation, the function routes the message to the correct queue. Besides the normal serverless Azure Functions in Azure, the function can also be hosted in a Kubernetes cluster. This repository provides both solutions.
Kubernetes-based Functions provides the Functions runtime in a Docker container with event-driven scaling through KEDA. KEDA can scale in to 0 instances (when no events are occurring) and out to n instances. It does this by exposing custom metrics for the Kubernetes autoscaler (Horizontal Pod Autoscaler). Using Functions containers with KEDA makes it possible to replicate serverless function capabilities in any Kubernetes cluster.
Infrastructure Code:
If you want to deploy the shovel with normal Azure Functions, please review the CLI script and ARM templates available under the /Infrastructure-Serverless folder.
If you want to host the Azure Functions in AKS, please review CLI scripts and ARM templates available undert the /Infrastructure-AKS folder.
Application Code:
The Docker File to build the Azure Function as a container is available under the /FunctionCode folder.
Message and routing Client to test the shovel application are available under the /MessageClients folder.
For more information on Azure Service Bus event based messaging patterns and samples, see:
https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-federation-overview
For more samples, see:
https://github.com/Azure-Samples/azure-messaging-replication-dotnet