question

VivekSinha-9774 avatar image
0 Votes"
VivekSinha-9774 asked VivekSinha-9774 edited

Unable to deploy Azure ML endpoint

I am able to build real-time inference pipeline for Wikipedia example but get error when deployed


Update: Service status is healthy, but test call return 'GatewayTimeout'.view real-time endpoint

I am able to deploy car price prediction example without errors.

What am i doing wrong?

92768-image.png


azure-machine-learning
image.png (74.9 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

GiftA-MSFT avatar image
0 Votes"
GiftA-MSFT answered GiftA-MSFT edited

Hi, thanks for reaching out. I'm not able to reproduce this error. I followed the steps outlined in this document and I was able to deploy the real-time endpoint successfully. If you continue to experience errors, can you verify the error details in deployment logs (ML Studio > Endpoints > Deployment Logs)?


92964-image.png



image.png (44.4 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

VivekSinha-9774 avatar image
0 Votes"
VivekSinha-9774 answered GiftA-MSFT commented

Link to deployment log file

https://ml.azure.com/endpoints/lists/realtimeendpoints/testnlp/logs?wsid=/subscriptions/031a3c8a-3a6c-4f2f-986d-3da4de8939f3/resourceGroups/Strabacus-1/providers/Microsoft.MachineLearningServices/workspaces/Med-NLP&tid=0e2f81da-258d-4872-b7f0-7cad11eb044a

I am unable to attach a ~100KB txt file which contains the log, hence refer to the link above.

Deployment error
Update: Service status is healthy, but test call return 'GatewayTimeout'.view real-time endpoint


Test result:

Failed to test real-time endpoint
Timeout of 20000ms exceeded.

I realized, link to endpoint error no longer exists after I deleted the endpoint. Is there a way to attach the txt file.

Do I need to increase timeout to provide enough time for processing? If yes, how?

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Okay, what error is contained in the deployment logs? You can simply search for the word error and share those details. Furthermore, you can change the scoring timeout under Advanced when deploying. If you continue to experience errors, can you share the region of your service as well as region/size of your compute resource so I can verify on my end based on the details provided? Thanks!


0 Votes 0 ·
VivekSinha-9774 avatar image
0 Votes"
VivekSinha-9774 answered GiftA-MSFT commented

@GiftA-MSFT

Region - West US 2
Compute - Virtual machine size
Standard_D2_v2 (2 cores, 7 GB RAM, 100 GB disk)
Processing unit
CPU - General purpose

Link to errorlog

https://app.box.com/s/t1mewexil483ylragx94bxgdcwbraqzi

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi, sorry for the delayed response and thanks for the details. Can you try creating a new experiment and follow the guideline in this document? Based on the error message, it seems the error is from the "score model" module, so, ensure data and schema is in a compatible format with trained model.


0 Votes 0 ·
VivekSinha-9774 avatar image
0 Votes"
VivekSinha-9774 answered VivekSinha-9774 edited

101538-nlp-error-v1.txtBased on the linked document - there are 2 models in the pipeline - Feature hashing and Ngram, so it would not work for deployment. Moreover, I also get an error to that effect.

I created 2 different versions 1) Feature Hashing only 2) NGram only followed rest of the steps as outlined in the linked document for deployment. As a note it is container deployment.

I still get the timeout error.

Update: Service status is healthy, but test call return 'BadGateway'. view real-time endpoint

Any help to get it resolved would be appreciated.

100794-image.png



image.png (33.7 KiB)
nlp-error-v1.txt (51.4 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.