語音命令Voice commanding

使用語音命令時,看起來通常用來做為目的機制,也就是指標 ( 「選取」 ) 或將您的命令導向至應用程式 ( 「查看它,例如」 ) 。When using voice commands, gaze is typically used as the targeting mechanism, whether as a pointer ("select") or to direct your command to an application ("see it, say it"). 當然,有些語音命令完全不需要目標,例如「移至開始」或「嗨,Cortana」。Of course, some voice commands don't require a target at all, like "go to start" or "Hey, Cortana."

裝置支援Device support

功能Feature HoloLens (第 1 代)HoloLens (1st gen) HoloLens 2HoloLens 2 沉浸式頭戴裝置Immersive headsets
語音命令Voice commanding ✔️✔️ ✔️✔️ ✔️ (連結頭戴式裝置)✔️ (with headset attached)

如何使用語音How to use voice

請考慮對您所建置的任何體驗新增語音命令。Consider adding voice commands to any experience that you build. 語音是控制系統和應用程式的功能強大且方便的方式。Voice is a powerful and convenient way to control the system and apps. 因為使用者說話時的語調和口音各異,適當選擇語音關鍵字才能確保系統會分毫不差地解讀出使用者的命令。Because users speak with a variety of dialects and accents, proper choice of speech keywords will make sure that your users' commands are interpreted unambiguously.

最佳作法Best practices

以下是有助於順利辨識語音的一些做法。Below are some practices that will aid in smooth speech recognition.

  • 使用精簡的命令 - 盡可能選擇有兩個以上音節的關鍵字。Use concise commands - When possible, choose keywords of two or more syllables. 口音不同的人在說單音節的單字時往往會使用不同的元音。One-syllable words tend to use different vowel sounds when spoken by persons of different accents. 範例:「播放影片」優於「播放目前選取的影片」Example: "Play video" is better than "Play the currently selected video"
  • 使用簡單詞彙 -範例:「顯示附注」優於「顯示牌子」Use simple vocabulary - Example: "Show note" is better than "Show placard"
  • 確定命令不具破壞性 - 確定可透過語音命令來採取的動作不具破壞性,如果使用者附近有其他人不小心觸發命令,也可以輕鬆地加以復原。Make sure commands are non destructive - Make sure any action that can be taken by a speech command is non destructive and can easily be undone in case another person speaking near the user accidentally triggers a command.
  • 避免類似發音的命令 - 避免註冊多個聽起來非常類似的語音命令。Avoid similar sounding commands - Avoid registering multiple speech commands that sound very similar. 範例:「顯示更多」和「顯示存放區」可能非常類似的發音。Example: "Show more" and "Show store" can be very similar sounding.
  • 將未使用的應用程式取消註冊 - 當應用程式並非處在會讓特定語音命令生效的狀態時,請考慮將其取消註冊,以免該命令與其他命令混淆。Unregister your app when not it use - When your app is not in a state in which a particular speech command is valid, consider unregistering it so that other commands are not confused for that one.
  • 使用不同口音進行測試 - 請使用不同口音的使用者測試應用程式。Test with different accents - Test your app with users of different accents.
  • 讓語音命令保持一致 - 如果 "Go back" 會回到上一頁,請在應用程式中保持這個行為。Maintain voice command consistency - If "Go back" goes to the previous page, maintain this behavior in your applications.
  • 避免使用系統命令 - 下列語音命令已保留給系統使用。Avoid using system commands - The following voice commands are reserved for the system. 應用程式請勿使用這些命令。These should not be used by applications.
    • "Hey Cortana""Hey Cortana"
    • "Select""Select"

"Select""Select"

在任何時候說出 "Select",都會啟用注視游標所指的目標。Saying "select" at any time will activate whatever the gaze cursor is pointing at.

注意:在 HoloLens 2 中,您必須先說出 "select" 這個字來叫用注視游標。Note: In HoloLens 2, the gaze cursor needs to first be invoked by saying the word "select". 再次說「選取」以啟動。Say "select" again to activate. 若要隱藏注視游標,只要使用您的手 airtap 或觸碰物件。To hide the gaze cursor, simply use your hands to airtap or touch an object.

看到什麼就說什麼See it, say it

Windows Mixed Reality 採用「看到什麼就說什麼」語音模型,按鈕上的標籤會與相關聯的語音命令完全相同Windows Mixed Reality has employed a "see it, say it" voice model where labels on buttons are identical to the associated voice commands. 因為標籤和語音命令沒有任何不一致,使用者會更加了解要說什麼才能控制系統。Because there isn’t any dissonance between the label and the voice command, users can better understand what to say to control the system. 為了強化這一項功能,當您停駐在某個按鈕上時,便會出現 「語音停駐提示」,來讓您知道哪些按鈕有語音功能。To reinforce this, while dwelling on a button, a "voice dwell tip" appears to communicate which buttons are voice enabled.

看到什麼就說什麼的範例 1

看到什麼就說什麼的範例 2See it say it example 2
「看到什麼就說什麼」的範例Examples of "see it, say it"

語音的優點Voice's strengths

語音輸入是很自然的意圖溝通方式。Voice input is a natural way to communicate our intents. 語音在介面 周遊 中特別有用,因為它可協助使用者切換介面的多個步驟, (使用者可能會在查看網頁時說「返回」,而不需要在應用程式) 中按一下 [上一頁] 按鈕。Voice is especially good at interface traversals because it can help users cut through multiple steps of an interface (a user might say "go back" while looking at a Web page, instead of having to go up and click the Back button in the app). 這項節省的時間對使用者對體驗的認知有強大的 情緒影響 ,並為他們提供少量的增強。This small time savings has a powerful emotional effect on a user’s perception of the experience and gives them a small amount of superpower. 當我們無法騰出雙手或是在執行 多工 處理時,使用語音也是很方便的輸入方法。Using voice is also a convenient input method when we have our arms full or are multi-tasking. 在鍵盤上輸入的裝置上, 語音聽寫 可以是更有效率的輸入方式。On devices where typing on a keyboard is difficult, voice dictation can be an efficient, alternative way to input. 最後,在某些情況下,當注視和手勢的 精確度範圍 有限時,語音可能是使用者唯一受信任的輸入方法。Lastly, in some cases when the range of accuracy for gaze and gesture are limited, Voice might be a user’s only trusted method of input.

使用語音如何讓使用者受益How using voice can benefit the user

  • 減少時間 - 語音應該會讓最終目標更有效率。Reduces time - it should make the end goal more efficient.
  • 最不費力 - 語音應該會讓工作變得更為流暢且更不費力。Minimizes effort - it should make tasks more fluid and effortless.
  • 降低認知負荷 - 語音既直覺、易於了解且容易記住。Reduces cognitive load - it's intuitive, easy to learn, and remember.
  • 符合社交規範 - 語音應該會符合社會行為規範。It's socially acceptable - it should fit in with societal norms in terms of behavior.
  • 語音很平常 - 語音隨時可以變成慣常行為。It's routine - voice can readily become a habitual behavior.

語音的缺點Voice's weaknesses

語音也有一些缺點。Voice also has some weaknesses. 缺點之一就是細微控制。Fine-grained control is one of them. (例如,使用者可能會說「更高」,但無法說出多少。(for example, a user might say "louder," but can’t say how much. 「一點」是不容易量化的詞。"A little" is hard to quantify. 使用語音來移動或縮放物體也很困難 (語音不會提供控制項的細微性)。Moving or scaling things with voice is also difficult (voice does not offer the granularity of control). 語音也有缺陷。Voice can also be imperfect. 有時候,語音系統會誤判命令,或無法聽到命令。Sometimes a voice system incorrectly hears a command or fails to hear a command. 不管什麼介面都很難從這類錯誤改正回來。Recovering from such errors is a challenge in any interface. 最後,在公開場合中,使用者可能不方便發出聲音,Lastly, voice may not be socially acceptable in public places. 或者有一些不能或不應該說的話。There are some things that users can’t or shouldn’t say. 遇到這樣的困境時,語音就能發揮所長,無往不利。These cliffs allow speech to be used for what it is best at.

語音反饋狀態Voice feedback states

當語音正確套用時,使用者會了解 他們能說什麼並獲得清楚的反饋 而知道系統 正確聽懂他們的語音When Voice is applied properly, the user understands what they can say and get clear feedback the system heard them correctly. 這兩個訊號會讓使用者有信心,確信他們可以使用語音作為主要輸入方式。These two signals make the user feel confident in using Voice as a primary input. 下圖顯示的是當系統辨識到語音輸入時會有什麼情形,以及系統會如何讓使用者知道這一點。Below is a diagram showing what happens to the cursor when voice input is recognized and how it communicates that to the user.

游標的語音反饋狀態Voice feedback states for cursor
游標的語音反饋狀態Voice feedback states for cursor

針對混合實境中的「語音」,使用者最應該了解的事Top things users should know about "speech" in mixed reality

  • 在鎖定按鈕時說出 "Select" (您可以在任何地方使用這個命令來按一下按鈕)。Say "Select" while targeting a button (you can use this anywhere to click a button).
  • 在某些應用程式中,您可以說出 應用程式列按鈕的標籤名稱 來採取動作。You can say the label name of an app bar button in some apps to take an action. 例如,在查看應用程式的同時,使用者可以說出「Remove」命令來從該世界中移除應用程式 (這可省下必須用手按一下按鈕的時間)。For example, while looking at an app, a user can say the command "Remove" to remove the app from the world (this saves time from having to click it with your hand).
  • 您可以說 「嗨 Cortana」 讓 Cortana 開始聽取命令。You can initiate Cortana listening by saying "Hey Cortana." 您可以 ( 「嗨 Cortana,Eiffel 塔的高度」)提出問題。) ,請告訴她開啟應用程式 ( "嗨 Cortana,open Netflix" ) ,或告訴她開啟 [開始] 功能表 ( [嗨 Cortana,讓我回家] ) 等等。You can ask her questions ("Hey Cortana, how tall is the Eiffel tower?"), tell her to open an app ("Hey Cortana, open Netflix"), or tell her to bring up the Start Menu ("Hey Cortana, take me home") and more.

使用者會有的語音相關常見問題和疑慮Common questions and concerns users have about voice

  • 我可以說什麼?What can I say?
  • 如何知道系統沒有聽錯?How do I know the system heard me correctly?
    • 系統一直聽錯我的語音命令。The system keeps getting my voice commands wrong.
    • 我提供了語音命令,系統卻沒有反應。It doesn’t react when I give it a voice command.
  • 我提供了語音命令,系統卻做出錯誤反應。It reacts the wrong way when I give it a voice command.
  • 如何讓我的語音以特定應用程式或應用程式命令作為目標?How do I target my voice to a specific app or app command?
  • 在 HoloLens 上的全像攝影畫面外,是否可以使用語音來命令物件?Can I use voice to command things out the holographic frame on HoloLens?

另請參閱See also