QnAMaker giving incorrect results for same text with different casing or punctuation

Sander Schutten 1 Reputation point
2020-08-21T08:35:43.257+00:00

I have a (translated to Dutch) version of the chitchat knowledgebase that includes a Q&A pair for 'who are you?' with the following phrasings, amongst many others:

  • "Wie ben jij"
  • "Wie ben je"

Depending on the casing of the text I get different results:

  • "wie ben je" -> Correct
  • "wie ben je?" -> Correct
  • "Wie ben je" -> Incorrect!

What's strange is that when I use the same casing as the phrasing it produces a completely different answer. Even more strange is that when I click inspect in the test window, the correct answer isn't even listed.

I've confirmed that:

  • the phrase "Wie ben je" isn't used for any of the other Q&A pairs except this one
  • I made sure to Save and train the knowledge base
  • I'm using a Qna service dedicated for the Dutch language and I didn't mix languages

What should I do to fix the recognition?

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,349 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. romungi-MSFT 41,861 Reputation points Microsoft Employee
    2020-08-27T13:52:23.867+00:00

    @Sander Schutten I have tried to export your file and created a new KB and ran the same test. Here is the result.

    20855-wie-ben-je.jpg

    20856-wie-ben-je-1.jpg

    I think both the scenarios provided the expected results. Could you please check if you can create a new QnA resource and create a new KB to test the same file? My best guess is the resource may be having issues or the app service tied to this QnA resource needs a restart. This can be done from Azure portal using the restart option in overview page of the resource.

    0 comments