Azure open AI on your own data is not Working properly in web app deployed , Frequently giving the below response "The requested information is not found in the retrieved data. Please try another query or topic."

Madhan Kumar 0

We have created a search service and used sharepoint as the data source , and used Azure Open AI on to use our own data. The responses are good from Chat playground and we deployed it into a web app , but now the responses are not all stable , most often it responds with "The requested information is not found in the retrieved data. Please try another query or topic.". May i Know the exact reason behind this inconsistent behaviour.

AshokPeddakotla-MSFT 27,726 Reputation points

2024-04-22T10:43:39.42+00:00

Madhan Kumar Greetings & Welcome to Microsoft Q&A forum!

Did you try setting AZURE_SEARCH_ENABLE_IN_DOMAIN parameter to "true" ?

When it is set to true, it limits responses to only queries relating to your data.

See Environment variables for more details.

Let me know if this is what you are looking for.
Madhan Kumar 0 Reputation points

2024-04-22T12:51:56.1666667+00:00

@AshokPeddakotla-MSFT

I have already enabled the parameter (set to true only ) and it is working fine and giving responses on my own data , I face the below mentioned Issues
Madhan Kumar 0 Reputation points

2024-04-22T13:03:52.2133333+00:00
@AshokPeddakotla-MSFT

I have enabled the setting AZURE_SEARCH_ENABLE_IN_DOMAIN parameter to "true" and is able to fetch good responses and works fine.

Issues:

At times it starts showing "The requested information is not found in the retrieved data. Please try another query or topic." Then for every subsequent question it provides the same response.

I tried to index the same question in Azure Search service , there it fetches the relevant documents but when it comes to Open AI it fails to produce the response though there is relevant information present in the docs.

Also I tried clearing the chat in the conversation then it behaves normally and fetches the responses .

Is it Anything to do with Past message context , since we pass past messages as context and passing this response "The requested information is not found in the retrieved data. Please try another query or topic." as context may causing the problem to generate the response ?

It fails in translation case as well , When i ask translate the above response it shows the same error . Is this because limiting response to data functionality , but transaltion has nothing to do with documents ?

Can you please help me with these issues?

Thanks in Advance.
AshokPeddakotla-MSFT 27,726 Reputation points

2024-05-03T13:56:47.4233333+00:00

Madhan Kumar Thanks for confirming.

When you pass the previous messages as context, it is possible that the service is not able to generate a relevant response based on the context provided.

You can try passing different context to the service and see if it generates a relevant response.