Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

attach_compute should set exit code after exception #113

Closed
algattik opened this issue Nov 26, 2019 · 0 comments · Fixed by #121
Closed

attach_compute should set exit code after exception #113

algattik opened this issue Nov 26, 2019 · 0 comments · Fixed by #121

Comments

@algattik
Copy link
Contributor

I got a transient service error while retrieving compute. An error was logged but the pipeline continued. The script fails to set an exit code when catching the exception:

ComputeTargetException:
	Message: Error occurred retrieving targets:
Response Code: 500
Headers: {'Cache-Control': 'no-cache', 'Pragma': 'no-cache', 'Content-Length': '294', 'Content-Type': 'application/json; charset=utf-8', 'Expires': '-1', 'x-ms-ratelimit-remaining-subscription-reads': '11999', 'x-ms-failure-cause': 'service', 'Request-Context': 'appId=cid-v1:6a27ce65-5555-41a3-85f7-b7a1ce31fd6b', 'x-ms-request-id': '|eaf2c3b2dc39574abbc4581269bde67b.8a46c099_1.1bf9b6d7_', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'x-ms-correlation-request-id': 'f3c9e09d-9986-43dc-a81e-9328fbb63de9', 'x-ms-routing-request-id': 'WESTEUROPE:20191126T054559Z:f3c9e09d-9986-43dc-a81e-9328fbb63de9', 'X-Content-Type-Options': 'nosniff', 'Date': 'Tue, 26 Nov 2019 05:45:59 GMT', 'Connection': 'close'}
Content: b'{"error":{"code":"InternalServerError","message":"An internal server error occurred. Please try again. If the problem persists, contact support","innererror":{"clientRequestId":"888141ac-de9b-418a-87e7-987fa829b2ae","serviceRequestId":"|eaf2c3b2dc39574abbc4581269bde67b.8a46c099_1.1bf9b6d7_"}}}'
	InnerException None
	ErrorResponse 
{
    "error": {
        "message": "Error occurred retrieving targets:\nResponse Code: 500\nHeaders: {'Cache-Control': 'no-cache', 'Pragma': 'no-cache', 'Content-Length': '294', 'Content-Type': 'application/json; charset=utf-8', 'Expires': '-1', 'x-ms-ratelimit-remaining-subscription-reads': '11999', 'x-ms-failure-cause': 'service', 'Request-Context': 'appId=cid-v1:6a27ce65-5555-41a3-85f7-b7a1ce31fd6b', 'x-ms-request-id': '|eaf2c3b2dc39574abbc4581269bde67b.8a46c099_1.1bf9b6d7_', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'x-ms-correlation-request-id': 'f3c9e09d-9986-43dc-a81e-9328fbb63de9', 'x-ms-routing-request-id': 'WESTEUROPE:20191126T054559Z:f3c9e09d-9986-43dc-a81e-9328fbb63de9', 'X-Content-Type-Options': 'nosniff', 'Date': 'Tue, 26 Nov 2019 05:45:59 GMT', 'Connection': 'close'}\nContent: b'{\"error\":{\"code\":\"InternalServerError\",\"message\":\"An internal server error occurred. Please try again. If the problem persists, contact support\",\"innererror\":{\"clientRequestId\":\"888141ac-de9b-418a-87e7-987fa829b2ae\",\"serviceRequestId\":\"|eaf2c3b2dc39574abbc4581269bde67b.8a46c099_1.1bf9b6d7_\"}}}'"
    }
}
An error occurred trying to provision compute.
algattik added a commit to algattik/MLOpsPython that referenced this issue Nov 28, 2019
* Use Azure CLI tasks to remove need for variables SP_APP_ID, SP_APP_SECRET, SUBSCRIPTION_ID, TENANT_ID
* Updated gettin_started.md to point out variable path to artifact (microsoft#117)
* Made random hyperparameter (ridge regression alpha) a pipeline parameter, setting its value in the DevOps pipeline (microsoft#107)
* Changed unit test to test actual training code (partially solves microsoft#74)
* Fixed: attach_compute should set exit code after exception (microsoft#113)
* Fixed scoring endpoint HTTP behavior (microsoft#110)
* Fixed PipelineParameters format in call to Azure ML Extension (microsoft#118)
* Fixed Model build environment for Azure Web App for containers (microsoft#119)
@dtzar dtzar closed this as completed in #121 Dec 6, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant