语音命令Voice commanding

使用语音命令时,注视通常用作目标机制,无论是作为指针 ( "选择" ) 还是将命令定向到应用程序 ( "看到它" ) 。When using voice commands, gaze is typically used as the targeting mechanism, whether as a pointer ("select") or to direct your command to an application ("see it, say it"). 当然,有些语音命令根本不需要目标,例如“去开始菜单”或“你好小娜”。Of course, some voice commands don't require a target at all, like "go to start" or "Hey, Cortana."

设备支持Device support

功能Feature HoloLens(第 1 代)HoloLens (1st gen) HoloLens 2HoloLens 2 沉浸式头戴显示设备Immersive headsets
语音命令Voice commanding ✔️✔️ ✔️✔️ ✔️(配有头戴显示设备)✔️ (with headset attached)

如何使用语音How to use voice

考虑为生成的任何体验添加语音命令。Consider adding voice commands to any experience that you build. 语音是控制系统和应用程序的一种强大而方便的方式。Voice is a powerful and convenient way to control the system and apps. 由于用户使用各种方言和口音说话,恰当选择语音关键字将确保用户的命令得到清晰的解释。Because users speak with a variety of dialects and accents, proper choice of speech keywords will make sure that your users' commands are interpreted unambiguously.

最佳做法Best practices

以下是一些有助于流畅语音识别的做法。Below are some practices that will aid in smooth speech recognition.

  • 使用简明命令 - 如果可能的话,选择两个或更多音节的关键词。Use concise commands - When possible, choose keywords of two or more syllables. 不同口音的人说单音节词时倾向于使用不同的元音。One-syllable words tend to use different vowel sounds when spoken by persons of different accents. 示例: "播放视频" 优于 "播放当前选定的视频"Example: "Play video" is better than "Play the currently selected video"
  • 使用简单词汇 -示例: "show note" 优于 "show placard"Use simple vocabulary - Example: "Show note" is better than "Show placard"
  • 确保命令是非破坏性的 - 确保语音命令可以执行的任何操作都是非破坏性的,并且可以很容易地撤消,以防在用户附近说话的另一个人意外触发命令。Make sure commands are non destructive - Make sure any action that can be taken by a speech command is non destructive and can easily be undone in case another person speaking near the user accidentally triggers a command.
  • 避免使用类似的语音命令 - 避免注册多个听起来非常相似的语音命令。Avoid similar sounding commands - Avoid registering multiple speech commands that sound very similar. 示例: "显示更多" 和 "显示存储" 的发音可能非常相似。Example: "Show more" and "Show store" can be very similar sounding.
  • 不使用应用时请取消注册应用 - 当应用没有处于特定语音命令有效的状态时,请考虑取消注册应用,使其他命令不会与该命令混淆。Unregister your app when not it use - When your app is not in a state in which a particular speech command is valid, consider unregistering it so that other commands are not confused for that one.
  • 使用不同的口音进行测试 - 由具有不同口音的用户测试应用。Test with different accents - Test your app with users of different accents.
  • 保持语音命令一致性 - 如果“返回”可转到上一页,请在应用程序中保持此行为。Maintain voice command consistency - If "Go back" goes to the previous page, maintain this behavior in your applications.
  • 避免使用系统命令 - 系统保留了以下语音命令。Avoid using system commands - The following voice commands are reserved for the system. 应用程序不应使用这些命令。These should not be used by applications.
    • “你好小娜”"Hey Cortana"
    • “选择”"Select"

“选择”"Select"

在任何时候说"选择"将激活凝视光标指向的任何内容。Saying "select" at any time will activate whatever the gaze cursor is pointing at.

注意:在 HoloLens 2 中,需要首先通过说 "select" 一词来调用注视光标。Note: In HoloLens 2, the gaze cursor needs to first be invoked by saying the word "select". 再次说 "选择" 激活。Say "select" again to activate. 若要隐藏注视光标,只需使用手 airtap 或触摸对象。To hide the gaze cursor, simply use your hands to airtap or touch an object.

看到它,说出来See it, say it

Windows Mixed Reality 采用了“看到它,说出来”的语音模型,在该模型中,按钮上的标签与相关的语音命令相同。Windows Mixed Reality has employed a "see it, say it" voice model where labels on buttons are identical to the associated voice commands. 由于标签和语音命令之间没有任何不一致,用户可以更好地理解应该说什么来控制系统。Because there isn’t any dissonance between the label and the voice command, users can better understand what to say to control the system. 为了加强这一点,在某个按钮上停留时,会显示“语音停留提示”,提示哪些按钮已启用语音功能。To reinforce this, while dwelling on a button, a "voice dwell tip" appears to communicate which buttons are voice enabled.

“看到它,说出来”示例 1

“看到它,说出来”示例 2See it say it example 2
“看到它,说出来”示例Examples of "see it, say it"

语音的优势Voice's strengths

语音输入是传达我们意图的自然方式。Voice input is a natural way to communicate our intents. 语音在接口遍历上特别不错,因为它可以帮助用户在查看网页时,用户可能会说 "返回",而不需要在应用) 中单击 "后退" 按钮,而是在界面的多个 (步骤。Voice is especially good at interface traversals because it can help users cut through multiple steps of an interface (a user might say "go back" while looking at a Web page, instead of having to go up and click the Back button in the app). 这一小段节省时间在用户对体验的认知上带来了强大的 情绪影响 ,并为他们提供少量的实现超级。This small time savings has a powerful emotional effect on a user’s perception of the experience and gives them a small amount of superpower. 当我们忙得不可开交或同时处理多项任务时,使用语音也是一种方便的输入方法。Using voice is also a convenient input method when we have our arms full or are multi-tasking. 在键盘上键入困难的设备上, 语音听写 可以是一种有效的输入方式。On devices where typing on a keyboard is difficult, voice dictation can be an efficient, alternative way to input. 最后,在某些情况下,如果注视和手势的 准确性范围 有限,则语音可能是用户的唯一受信任的输入方法。Lastly, in some cases when the range of accuracy for gaze and gesture are limited, Voice might be a user’s only trusted method of input.

语音的使用如何让用户受益How using voice can benefit the user

  • 省时 - 它应该使最终目标更高效。Reduces time - it should make the end goal more efficient.
  • 最大限度地减少工作量 - 它应该使任务更加流畅和轻松。Minimizes effort - it should make tasks more fluid and effortless.
  • 减少认知压力 - 它是直观的,易于学习和记忆。Reduces cognitive load - it's intuitive, easy to learn, and remember.
  • 它在社会上是可以接受的 - 它应该在行为方面符合社会规范。It's socially acceptable - it should fit in with societal norms in terms of behavior.
  • 它是常规的 - 语音很容易成为一种习惯行为。It's routine - voice can readily become a habitual behavior.

语音的劣势Voice's weaknesses

语音也有一些劣势。Voice also has some weaknesses. 精细控制就是其中之一。Fine-grained control is one of them. (例如,用户可能会说 "更大",但不能说出多少。(for example, a user might say "louder," but can’t say how much. “有点”很难量化。"A little" is hard to quantify. 使用语音移动或缩放内容也很困难(语音不提供控制精细度)。Moving or scaling things with voice is also difficult (voice does not offer the granularity of control). 语音也可能是不完美的。Voice can also be imperfect. 有时,语音系统会错误地听到命令或无法听到命令。Sometimes a voice system incorrectly hears a command or fails to hear a command. 从这些错误中恢复对于任何界面而言都是难题。Recovering from such errors is a challenge in any interface. 最后,声音在公共场所可能不被公众所接受。Lastly, voice may not be socially acceptable in public places. 有些话用户不能或不应该说。There are some things that users can’t or shouldn’t say. 这些限制使得语音应用于其最擅长的领域。These cliffs allow speech to be used for what it is best at.

语音反馈状态Voice feedback states

当语音应用正确时,用户了解他们能说什么,并得到清晰的反馈 - 系统正确地听到了用户说的话。When Voice is applied properly, the user understands what they can say and get clear feedback the system heard them correctly. 这两个信号使用户在使用语音作为主要输入方法时充满自信。These two signals make the user feel confident in using Voice as a primary input. 下面的图表显示了识别语音输入时光标发生的情况以及它是如何将信息传达给用户的。Below is a diagram showing what happens to the cursor when voice input is recognized and how it communicates that to the user.

光标的语音反馈状态Voice feedback states for cursor
光标的语音反馈状态Voice feedback states for cursor

在混合现实中,用户应该知道的关于“语音”的重要事项Top things users should know about "speech" in mixed reality

  • 在将一个按钮设置为目标时,说“选择”(可以在任何位置使用这种方法来单击按钮)。Say "Select" while targeting a button (you can use this anywhere to click a button).
  • 可以在某些应用中通过说出应用栏按钮的标签名称来执行操作。You can say the label name of an app bar button in some apps to take an action. 例如,在查看应用时,用户可以说“移除”命令以从现实中移除应用(这样可以节省用手单击按钮的时间)。For example, while looking at an app, a user can say the command "Remove" to remove the app from the world (this saves time from having to click it with your hand).
  • 说“你好小娜”可以启动 Cortana 侦听。You can initiate Cortana listening by saying "Hey Cortana." 你可以询问她的问题 ( "你好 Cortana,Eiffel 塔有多高?") ,告诉她打开一个应用 ( "你好 Cortana,打开 Netflix" ) ,或者告诉她启动菜单 ( "你好 Cortana,请回家" ) 等。You can ask her questions ("Hey Cortana, how tall is the Eiffel tower?"), tell her to open an app ("Hey Cortana, open Netflix"), or tell her to bring up the Start Menu ("Hey Cortana, take me home") and more.

用户对语音的常见问题和关注点Common questions and concerns users have about voice

  • 我可以说什么?What can I say?
  • 我如何知道系统正确听到了我说的话?How do I know the system heard me correctly?
    • 系统总是理解错误我的语音命令。The system keeps getting my voice commands wrong.
    • 当我发出语音命令时,系统不会做出反应。It doesn’t react when I give it a voice command.
  • 当我发出语音命令时,系统的反应是错误的。It reacts the wrong way when I give it a voice command.
  • 我如何将我的语音定向到一个特定的应用或应用命令?How do I target my voice to a specific app or app command?
  • 我可以使用语音来对 HoloLens 上的全息帧执行命令吗?Can I use voice to command things out the holographic frame on HoloLens?

另请参阅See also