Timeout Exception with SASL SCRAM Authentication with AWS MSK

[sureshbandi]

I am encountering a timeout exception when trying to use SASL SCRAM authentication with AWS MSK. It is important to mention that testing the same creds with an EC2 instance from the same subnet works fine.

I have ensured that the necessary ports for SASL SCRAM (typically port 9096) are open both inbound and outbound in the security group and network access control list associated with my MSK cluster. The subnets have the correct route tables and configurations to allow communication between the cluster and the EC2 instance.

I have also reviewed my Terraform configuration for any potential misconfigurations, such as incorrect authentication settings or network configurations. However, despite these checks, the timeout exception continues to occur.

provider "kafka" {
bootstrap_servers = var.bootstrap_servers
sasl_mechanism = "scram-sha512"
sasl_username = var.sasl_username
sasl_password = var.sasl_password
tls_enabled = true
}

Can someone please provide assistance in troubleshooting and resolving this issue? Any suggestions, fixes, or guidance would be greatly appreciated. Let me know if there is any specific information or logs I can provide to help diagnose the problem further.

Thank you in advance for your help!