Phonemes are not available for pronunciation recognition in french

GOMES-ALVES-DOS-SANTOS Bruna 0 Reputation points
2024-05-18T21:38:28.0266667+00:00

On the result of the pronunciation recognition, if we set to "en-US", we have all the results for the phonemes spoken/matches. As below.


"Phonemes": [
                            {
                                "Phoneme": "k",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 100,
                                    "NBestPhonemes": [
                                        {
                                            "Phoneme": "k",
                                            "Score": 100
                                        },
                                        {
                                            "Phoneme": "oʊ",
                                            "Score": 4
                                        },
                                        {
                                            "Phoneme": "ɡ",
                                            "Score": 3
                                        },
                                        {
                                            "Phoneme": "w",
                                            "Score": 3
                                        },
                                        {
                                            "Phoneme": "p",
                                            "Score": 2
                                        }
                                    ]
                                },
                                "Offset": 11300000,
                                "Duration": 1200000
                            },
                            {
                                "Phoneme": "w",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 100,
                                    "NBestPhonemes": [
                                        {
                                            "Phoneme": "w",
                                            "Score": 100
                                        },
                                        {
                                            "Phoneme": "k",
                                            "Score": 75
                                        },
                                        {
                                            "Phoneme": "r",
                                            "Score": 3
                                        },
                                        {
                                            "Phoneme": "ɛ",
                                            "Score": 1
                                        },
                                        {
                                            "Phoneme": "ɡ",
                                            "Score": 0
                                        }
                                    ]

But for "fr-FR", I just receive an empty string for the phoneme and cannot make a match with the IPA dictionaries.

"Phonemes": [
                            {
                                "Phoneme": "",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 52
                                },
                                "Offset": 10100000,
                                "Duration": 1100000
                            },
                            {
                                "Phoneme": "",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 55
                                },
                                "Offset": 11300000,
                                "Duration": 700000
                            },
                            {
                                "Phoneme": "",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 64
                                },
                                "Offset": 12100000,
                                "Duration": 1100000
                            },
                            {
                                "Phoneme": "",
                                "PronunciationAssessment": {
                                    "AccuracyScore": 49
                                },
                                "Offset": 13300000,
                                "Duration": 500000
                            }
                        ]
                    },
                    {

Azure AI Speech
Azure AI Speech
An Azure service that integrates speech processing into apps and services.
1,455 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. navba-MSFT 18,080 Reputation points Microsoft Employee
    2024-05-20T04:55:35.8866667+00:00

    @GOMES-ALVES-DOS-SANTOS Bruna Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

    .

    User's image

    This is by design since by design since fr-FR doesn't expose phoneme name yet. Please refer this docs.

    .



    Also note that if phoneme name is not available, both syllable and spoken phoneme are not available either. Pronunciation assessment supports syllable groups only in en-US with IPA and with SAPI. More info here.

    .

    Regarding the ETA in the roadmap for the Pronunciation Assessment support for (french locale) fr-FR, We can prioritize our work if your usage on Pronunciation Assessment is large than 1k/month, we can priority our work and support to expose the phoneme name or reach the minimum of Commitment Tiers

    User's image

    Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

    **

    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.