What is the reason for significant differences in latency between OpenAI and OpenAI Azure for GPT-4-vision?
Requests sent to the gpt-v vision preview in us-west through the OpenAI Azure integration have an order of magnitude higher latency than the same request(s) sent through the OpenAI platform directly. We would like to understand the reasons behind this…
"limit responses to your data content" checkbox in https://oai.azure.com/ does not have any effect on the LLM response.
The "limit responses to your data content" checkbox in https://oai.azure.com/ chat playground does not have any effect on the LLM response. LLM always uses my own data source ( Azure AI Search service) without taking into consideration if…
Problem with azure completion rest api
Hello, I'm trying implement one solution with azure open ai completion rest api. I'm using the version 2024-02-01 that is stable. I'm using the open AI services with AI Search as source to performe search in my own documentation that I put in blob…
Troubleshooting quota discrepancies in Azure OpenAI Standard-Global deployment
I am using Azure OpenAI service's Global-Standard deployment method to deploy a GPT-4o model. However, while I have access to multiple subscriptions, I noticed that the quota for Global-Standard differs between them. For example, one subscription has a…
CRUD on Azure Vector Index/database
Hi I'm currently working on a PromptFlow in Azure. The flow has two vector indexes attached. All data is either in the form of .txt og .pdf and are stored i blobs in two seperate folders in Azure Blob Store. Things are going great and my flow is inching…
The quota for models in my account is significantly different from the default quota described in the documentation
I noticed that many of my models, such as GPT-35-Turbo, GPT-4, GPT-4-Turbo, or the latest GPT-4o model, have a TPM of only 1K in Azure AI Studio (essentially an unusable state). However, according to Microsoft documentation, the default TPM is 150K,…
Error occurred when using Retrieval feature in Azure Assistant : Retrieval Tools Not Supported
I encountered an error while trying to use the Retrieval feature in Azure Assistant and would appreciate any help resolving it. Below are the details of the error: could you also support how to download the file by fileID? Code: const { OpenAIClient,…
Is it possible to submit a batch run with evaluation programmatically in Azure AI Studio?
https://learn.microsoft.com/en-us/azure/ai-studio/how-to/flow-bulk-test-evaluation#submit-a-batch-run-and-use-an-evaluation-method Can these steps be completed programmatically via SDK? Are there plans to support this?
Enabling Azure Service Access to OpenAI Service through NSG on Private Endpoint: Exploring Exception Checkbox
Today, I deployed a new OpenAI service in my Vnet (with private endpoint). I noticed that there is a new checkbox option called [Exception] in the network settings. However, during my deployment, (including my previously created open ai service) I…
Azure Open AI connection for copilot studio fails
After following the steps for deploying a chat from Azure OpenAI in copilot studio (https://learn.microsoft.com/en-us/microsoft-copilot-studio/nlu-generative-answers-azure-openai#prerequisites) I get the following error that means: "An error…
Is there any API available to directly connect to Azure ai search index
In Azure AI search, we have an search explorer option where we can search a question and get the answer with a confidence score as below. Do we have REST API's or .net packages available to access azure search the using the index name? We have open ai…
Azure open ai studio data configuration is creating an extra index in azure ai search
Hi team, We are using azure open ai studio to configure the private data configured in azure blob storage. Once the configuration is done its creating and extra index and indexer in azure ai search Actual index name i provided is 'openai' but one more…
When Will OpenAI's New Embedding Models Be Available In Australia
When will text-embedding-3-large and text-embedding-3-small be available in Australia?
Why i can't see text-davinci-003 model in my Azure OpenAI Studio?
I can create model deployment with [text-davinci-003] a month before, but yesterday i can't see text-davinci-003 available in OpenAI Studio. I want to know what has happened?
What are Azure OpenAI Assistants PDF reading capabilities?
I have been trying to open and read PDF files using an assistant in the studio. My goal is to see if I am able to read images out of PDF files. Every time I try currently I get instantly rate limited. Regardless of the rate limiting, are the Assistants…
Function call with Azure OpenAI gpt-4o returns 400 error although the messages are valid
Hi support team, I am testing the new Azure Open AI gpt-4o model but I get the error with function call even though my input messages are correct. Here are the code: from dotenv import load_dotenv load_dotenv() from openai import OpenAI,…
OpenAI Content Filtering Low/Medium/High vs. Moderations API
Hi, I've been testing using OpenAI's APIs directly, but now that I'm moving my product to production I'm going to use Azure directly. I used their moderations API which has scores for categories, but I noticed that Azure has low/medium/high instead of…
Issue with Automatic Index Update in Azure OpenAI Studio Using BLOB Storage
I want to create a Retrieval-Augmented Generation (RAG) system using Azure OpenAI, Azure AI Search, and a Storage Account. When selecting the data source as Blob Storage in OpenAI Studio, the index should automatically update when documents are added or…
Retrieving Image Files by File ID in Azure Assistant Open AI with JavaScript
I'm seeking documentation on how to retrieve an image file by file ID in Azure Assistant Open AI. I aim to download it using JavaScript. Any guidance or resources would be greatly appreciated. Thank you in advance!"
Language Studio Auto-label with GPT not working, job always fails
Hey, Since some time I've been trying to test the auto-label with GPT function in Language Studio. I'm just following https://learn.microsoft.com/en-us/azure/ai-services/language-service/custom-text-classification/how-to/use-autolabeling. However, I…