Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Salesforce connector runs out of memory #11580

Open
amatasci opened this issue Dec 18, 2024 · 8 comments
Open

Salesforce connector runs out of memory #11580

amatasci opened this issue Dec 18, 2024 · 8 comments
Assignees
Labels
Connector Connector specialty review needed

Comments

@amatasci
Copy link

amatasci commented Dec 18, 2024

Describe the bug
Depending on the amount of events to ingest, the Salesforce Function App can run out of memory and stop ingesting audit events

To Reproduce
Steps to reproduce the behavior:

  1. Deploy the Sentinel Salesforce connector
  2. Configure it to run daily
  3. The function app will run every day and be end in an Error status
  4. The error will be something like "Executed 'Functions.SalesforceSentinelConnector' (Failed, Id=4a05cd16-e314-4a2e-ae28-xxxxxxxxx, Duration=84034ms)". After opening a support case (#2412090050003338) it has been confirmed that the issue is related to the function running out of memory

Expected behavior
The function app should ingest all events regardless of the number and without running out of memory

Screenshots
Image

@v-sudkharat v-sudkharat added the Connector Connector specialty review needed label Dec 19, 2024
@v-sudkharat
Copy link
Contributor

Hi @amatasci, Thanks for flagging this issue. Could you please let us know what's your current plan for function app? And to address out of memory issue you can update the function app plan to Premium app service plan.
Here is a doc which can help to upgrade the plan - https://learn.microsoft.com/en-us/azure/azure-functions/functions-premium-plan?tabs=portal

@amatasci
Copy link
Author

Hello, we have a Dynamic / Y1 plan, this is the default one created during the deployment of the connector.
How can we modify it to a Premium one?

@v-sudkharat
Copy link
Contributor

@amatasci, Do you able to upgrade from below shared one ? -
Image

@v-sudkharat
Copy link
Contributor

@amatasci -
1 :
Image

2:
Image

@amatasci
Copy link
Author

This possibility isn't available, all options are grayed out

@v-sudkharat
Copy link
Contributor

@amatasci, Is the raised support case are still open? Actually, this upgradation for existing app service needs to be check by the function app team.

@amatasci
Copy link
Author

No, MS support closed it because they said it's not a Function App issue

@v-sudkharat
Copy link
Contributor

@amatasci,
The current existing deployed function app which contains consumption plan does not support the upgrade, so creation of new function app with premium plan helps you to get unblocked from this issue.

You can follow the below shared doc to create a function app manually by selecting the plan according to your requirement:-

Please go through the below doc for Function App plans with pricing details: -
https://learn.microsoft.com/en-us/azure/azure-functions/functions-scale?WT.mc_id=AZ-MVP-5003203#overview-of-plans

Additionally,
We have updated the below ARM template in which the plan has been upgraded to the PremiumV2 but unable to test it due permission / credentials required.
If you have any Testing Environment (Not production), could you please deploy the below shared ARM template by using custom deployment and check for the connector working status -
ARM template file : - azuredeploy_Connector_Salesforce_Service_Cloud_AzureFunction.json

To custom deploy this template :-
a. Search Custom deployment in azure home page :
Image

b. Select it and past the above ARM template content in custom deployment page :-
Image
c.
Image

Note that, Please do change the function app name while deployment of function in same resource group where old fun app has been already deployed to avoid the existing function override.

Once this function app gets deployed successfully, kindly monitor the logs flow and let us know if you get error.

Many thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Connector Connector specialty review needed
Projects
None yet
Development

No branches or pull requests

3 participants