question

dimitrisrakantas-7029 avatar image
0 Votes"
dimitrisrakantas-7029 asked romungi-MSFT commented

Transliteration support

Hi,
i am trying to use the transliteration api to transliterate a Japanese name. but i am getting as a response the same input(with Japanese characters). I tried the translate api with the same name and i get as response something that looks more than the transliteration response.
Does the translate api works also as transliteration for Japanese names?

example:
name(imput):スミエ ウチワ - transliteration(output):スミエ ウチワ -- translation(output):Sumie Uchiwa

name(imput):カオ アノ - transliteration(output):カオ アノ -- translation(output):Khao Ano

azure-translator
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@dimitrisrakantas-7029 Thanks for spotting this. We have tested this scenario with the above terms and it seems like the response is not correct. We have reached out internally to our product team for more details/clarification. We will let you know more details about the issue as soon as we receive a response.

Could you also try other Japanese terms if similar behavior is seen as it looks like some terms are only displaying this behavior?

0 Votes 0 ·
romungi-MSFT avatar image
0 Votes"
romungi-MSFT answered

@dimitrisrakantas-7029 Could you please check the response from the transliterate API now and check if it works? Here is a screenshot of the response after this was addressed by our team.


13016-transliterate.jpg




transliterate.jpg (91.1 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

dimitrisrakantas-7029 avatar image
0 Votes"
dimitrisrakantas-7029 answered romungi-MSFT commented

@romungi-MSFT I checked and I am still getting as a response the same input in Japanese characters

Here is an example with my call with 10 Japanese names

URL: https://api.cognitive.microsofttranslator.com/transliterate?api-version=3.0&language=ja&fromScript=Jpan&toScript=Latn
Method: POST
Header: Content-Type: application/json
Ocp-Apim-Subscription-Key: xxxxxxxxxxxxxxxxxxxxxxxxxx
Ocp-Apim-Subscription-Region: westeurope



Content: [ {"Text":"カオリ シバヤマ","script":"jpan"},
{"Text":"ナオミ ウエノ","script":"jpan"},
{"Text":"ケンタ ゴウハラ","script":"jpan"},
{"Text":"ナホ ナガタ","script":"jpan"},
{"Text":"ダイキ ナカモト","script":"jpan"},
{"Text":"テツフミ オオクシ","script":"jpan"},
{"Text":"トシユキ コジマ","script":"jpan"},
{"Text":"ムツコ スズキ","script":"jpan"},
{"Text":"エシン コジマ","script":"jpan"},
{"Text":"キョウコ サトウ","script":"jpan"}
]


Response: [{
"text": "カオリ シバヤマ",
"script": "Latn"
}, {
"text": "ナオミ ウエノ",
"script": "Latn"
}, {
"text": "ケンタ ゴウハラ",
"script": "Latn"
}, {
"text": "ナホ ナガタ",
"script": "Latn"
}, {
"text": "ダイキ ナカモト",
"script": "Latn"
}, {
"text": "テツフミ オオクシ",
"script": "Latn"
}, {
"text": "トシユキ コジマ",
"script": "Latn"
}, {
"text": "ムツコ スズキ",
"script": "Latn"
}, {
"text": "エシン コジマ",
"script": "Latn"
}, {
"text": "キョウコ サトウ",
"script": "Latn"
}]

· 9
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@dimitrisrakantas-7029 Thanks for letting us know. There seems to be an issue with Japanese transliteration in the service currently and we have reported these examples too. This may need a model update and our team has created a bug internally to track this. We will update this thread as soon as we have an update. Thanks!!

0 Votes 0 ·

@dimitrisrakantas-7029 Our team has provided a workaround for this scenario until the fix is deployed. If the input script for Japanese is full width the transliteration works as expected. Could you please try to use full width and check if it works?

For example the same name in half and full width:

 Input:
 [
     {"Text":"カオリ シバヤマ","script":"jpan"},
     {"Text":"カオリ シバヤマ","script":"jpan"}
 ]
    
 Output: 
 [
     {
         "text": "カオリ シバヤマ",
         "script": "Latn"
     },
     {
         "text": "caori shibayama",
         "script": "Latn"
     }
 ]



0 Votes 0 ·

Hi,

the workaround with fullwidth is working as expected.
Is there any service to convert from halfwidth to fullwidth?

Also is there any estimation on the plan when this issue will be fixed??

Some more questions:

Is there not transliteration for Russian/Ukraine?(maybe because translation is the same as transliteration in these cases?)

Does Japanese transliteration api supports all writing systems(Katakana, Han, Hiragana)?

Thanks

0 Votes 0 ·
Show more comments