Cognitive Services in Azure Synapse Analytics

Using pretrained models from Azure Cognitive Services, you can enrich your data with artificial intelligence (AI) in Azure Synapse Analytics.

Azure Cognitive Services are cloud-based services that add cognitive intelligence to your data even if you don't have AI or data science skills. There are a few ways you can use these services with your data in Synapse Analytics:

  • The Cognitive Services wizard in Synapse Analytics generates PySpark code in a Synapse notebook that connects to a cognitive service using data in a Spark table. Then, using pretrained machine learning models, the service does the work for you to add AI to your data. Check out Sentiment analysis wizard and Anomaly detection wizard for more details.

  • Synapse Machine Learning (SynapseML) allows you to build powerful and highly scalable predictive and analytical models from various Spark data sources. Synapse Spark provide built-in SynapseML libraries including Cognitive Services on Spark. Check out Tutorials for more details.

  • Starting from the PySpark code generated by the wizard, or the example SynapseML code provided in the tutorial, you can write your own code to use other cognitive services with your data. See What are Azure Cognitive Services? for more information about available services.

Get started

The tutorial, Pre-requisites for using Cognitive Services in Azure Synapse, walks you through a couple steps you need to perform before using Cognitive Services in Synapse Analytics.

Tutorials

The following tutorials provide complete examples of using Cognitive Services in Synapse Analytics.

Available Cognitive Services APIs

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Bing Image Search BingImageSearch Images - Visual Search V7.0 Not Supported

Anomaly Detector

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Detect Last Anomaly DetectLastAnomaly Detect Last Point V1.0 Supported
Detect Anomalies DetectAnomalies Detect Entire Series V1.0 Supported
Simple DetectAnomalies SimpleDetectAnomalies Detect Entire Series V1.0 Supported

Computer vision

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
OCR OCR Recognize Printed Text V2.0 Supported
Recognize Text RecognizeText Recognize Text V2.0 Supported
Read Image ReadImage Read V3.1 Supported
Generate Thumbnails GenerateThumbnails Generate Thumbnail V2.0 Supported
Analyze Image AnalyzeImage Analyze Image V2.0 Supported
Recognize Domain Specific Content RecognizeDomainSpecificContent Analyze Image By Domain V2.0 Supported
Tag Image TagImage Tag Image V2.0 Supported
Describe Image DescribeImage Describe Image V2.0 Supported

Translator

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Translate Text Translate Translate V3.0 Not Supported
Transliterate Text Transliterate Transliterate V3.0 Not Supported
Detect Language Detect Detect V3.0 Not Supported
Break Sentence BreakSentence Break Sentence V3.0 Not Supported
Dictionary lookup (alternate translations) DictionaryLookup Dictionary Lookup V3.0 Not Supported
Document Translation DocumentTranslator Document Translation V1.0 Not Supported

Face

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Detect Face DetectFace Detect With Url V1.0 Supported
Find Similar Face FindSimilarFace Find Similar V1.0 Supported
Group Faces GroupFaces Group V1.0 Supported
Identify Faces IdentifyFaces Identify V1.0 Supported
Verify Faces VerifyFaces Verify Face To Face V1.0 Supported

Form Recognizer

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Analyze Layout AnalyzeLayout Analyze Layout Async V2.1 Supported
Analyze Receipts AnalyzeReceipts Analyze Receipt Async V2.1 Supported
Analyze Business Cards AnalyzeBusinessCards Analyze Business Card Async V2.1 Supported
Analyze Invoices AnalyzeInvoices Analyze Invoice Async V2.1 Supported
Analyze ID Documents AnalyzeIDDocuments identification (ID) document model V2.1 Supported
List Custom Models ListCustomModels List Custom Models V2.1 Supported
Get Custom Model GetCustomModel Get Custom Models V2.1 Supported
Analyze Custom Model AnalyzeCustomModel Analyze With Custom Model V2.1 Supported

Speech-to-text

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Speech To Text SpeechToText SpeechToText V1.0 Not Supported
Speech To Text SDK SpeechToTextSDK Using Speech SDK Version 1.14.0 Not Supported

Text Analytics

API Type SynapseML APIs Cognitive Service APIs (Versions) DEP VNet Support
Text Sentiment V2 TextSentimentV2 Sentiment V2.0 Supported
Language Detector V2 LanguageDetectorV2 Languages V2.0 Supported
Entity Detector V2 EntityDetectorV2 Entities Linking V2.0 Supported
NER V2 NERV2 Entities Recognition General V2.0 Supported
Key Phrase Extractor V2 KeyPhraseExtractorV2 Key Phrases V2.0 Supported
Text Sentiment TextSentiment Sentiment V3.1 Supported
Key Phrase Extractor KeyPhraseExtractor Key Phrases V3.1 Supported
PII PII Entities Recognition Pii V3.1 Supported
NER NER Entities Recognition General V3.1 Supported
Language Detector LanguageDetector Languages V3.1 Supported
Entity Detector EntityDetector Entities Linking V3.1 Supported

Next steps