Kafka Trigger and Functions Premium Plan Scaling

[shanavt]

Can Function Premium Plan instances scale up to the number of partitions in Kafka? What I observed is that the number of function instances spun up under the elastic premium plan is always lower than the number of partitions. This is the same behavior even if I have a large number of always-ready instances in the premium plan. For example. If I have a Kafka topic with 32 partitions and I have a function app with 10 always ready instances, I only see 4 0r 5 instances active to process the messages even when there are messages in all the partitions.

[shrohilla]

@shanavt can you check the scaleout in settings section of functionapp

[shanavt]

@shrohilla - The scale out setting for the function app is configured properly. The issue is even if I have always ready instances set to ( say 10), the messages are processed only by 2 or 3 instances. There are 32 partitions in Kafka and messages are available in all partitions

[shrohilla]

@shanavt, I think you need to check your producer logs, is that producing data uniformly.
I think key is not provided to producer while producing, I would recommend, create 32 different keys and use them to write in topic for uniform distribution.