Share via

Issues with Azure Assistant API File Search and Response Times

Kaja Sherief 95 Reputation points
2024-05-14T10:47:33.13+00:00

I am currently working with the Azure Assistant API and facing some challenges. Specifically, when I attempt to add files and utilize function calls, the file search functionality does not work as expected. Despite providing proper instructions, the API often responds with "I don't have the information," even though the necessary data is available in the files.

I have tested this with GPT-3.5 Turbo, GPT-4, and GPT-4 Turbo, but the problem persists across all models. Additionally, the response times are significantly longer compared to the standard OpenAI Assistant API, which performs well in terms of file search, function calls, and response times.

I need further support on this issue.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,324 questions
Azure AI Document Intelligence
Azure AI Document Intelligence
An Azure service that turns documents into usable data. Previously known as Azure Form Recognizer.
1,449 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,458 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Gowtham CP 1,970 Reputation points
    2024-05-14T11:18:29.0066667+00:00

    Hello Kaja Sherief

    Thanks for reaching out in the Microsoft Q&A!

    To address challenges with the file search functionality while using the Azure Assistant API, you should consult the official documentation for confirmation and updates, particularly the Azure Assistant API Documentation. Even if file search is available, you may encounter issues related to file indexing or permissions. It's imperative to ensure that your uploaded files are in a supported format, properly indexed, and that you grant the Assistant sufficient permissions to access them. Adjusting the temperature setting in your prompts, typically setting it higher around 1.0, can enhance the flexibility and creativity of your search approach with the Assistant. For further insights and guidance, consider referring to materials such as the Microsoft Azure AI Services documentation Azure Assistant API Documentation and blog posts like Retrieval with the Azure OpenAI Assistants API Retrieval with the Azure OpenAI Assistants API.

    If you found this solution helpful, consider accepting it.

    0 comments