question

Ashi-5894 avatar image
0 Votes"
Ashi-5894 asked YutongTie-MSFT edited

Custom Vision Quick Test function

I want to know if it shows same results as Predict API would show? basically what are the Quick Test predictions based on?

Is there any official detailed information about how Quick Test function works? my Quick Test results are very different from the offline TensorFlow models that I exported, that's why I'm asking.

Thank you

azure-custom-vision
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @Ashi-5894

Thanks for reaching out to us here, in most of the situations, they are different since the quick test is only used when you want to check the latest iteration's performance.

The Quick Test uses the most recently trained iteration of your model only, like the below screenshot, the iteration 4 will be used:
https://docs.microsoft.com/en-us/azure/cognitive-services/custom-vision-service/test-your-model#test-your-model
196434-image.png

The Predict API uses the iteration you selected the best performance one to publish:
https://docs.microsoft.com/en-us/azure/cognitive-services/custom-vision-service/use-prediction-api#publish-your-trained-iteration
196390-image.png


Besides that, I think the guidance of how to improve the model you may need: https://docs.microsoft.com/en-us/azure/cognitive-services/custom-vision-service/getting-started-improving-your-classifier

I hope this helps, please let me know if you need futher help.

Regards,
Yutong

-Please kindly accept the answer if you feel helpful to help the community, thanks!


0 Votes 0 ·
image.png (83.2 KiB)
image.png (274.8 KiB)
YutongTie-MSFT avatar image
0 Votes"
YutongTie-MSFT answered Ashi-5894 commented

Hello @Ashi-5894

Thanks for your follow up, just double confirmed with the product manager, the quick answer is YES.

Please let me know if you need further assistance, hope this helps.

Regards,
Yutong

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thank you!

0 Votes 0 ·
Ashi-5894 avatar image
0 Votes"
Ashi-5894 answered

Thank you for your reply, but I'm afraid it doesn't answer my question. When using Quick Test there's actually a drop down menu for selecting the iterations, so it doesn't have to be the last one when you are testing.

My question specifically is if Quick test with iteration X would show same results as using prediction API with a published iteration X.

Thank you

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.