Beta 测试和目标分发Beta testing and targeted distribution

无论你如何仔细地测试应用,都不如通过让其他人使用它来进行实际测试。No matter how carefully you test your app, there’s nothing like the real-world test of having other people use it. 测试人员可能会发现你所忽略的问题,例如拼写错误、混乱的应用流程或可能导致该应用崩溃的错误。Your testers may discover issues that you’ve overlooked, such as misspellings, confusing app flow, or errors that could cause the app to crash. 然后,你将有机会在向公众发布提交之前修复这些问题,从而推出更完善的最终产品。You’ll then have a chance to fix those problems before you release the submission to the public, resulting in a more polished final product.

合作伙伴中心提供了几个选项让测试人员提供给公众之前试用您的应用程序。Partner Center gives you several options to let testers try out your app before you offer it to the public.

无论你选择哪种方法,对应用进行 beta 版本测试时需要牢记以下几点。Whichever method you choose, here are some things to keep in mind as you beta test your app.

  • 测试人员下载应用后,你无法撤销对该应用的访问权限。You can’t revoke access to the app after a tester has downloaded it. 一旦他们下载应用,他们便可以继续使用它,并且将获得你随后发布的任何更新。Once they have downloaded the app, they can continue to use it, and they’ll get any updates that you subsequently publish.
  • 你将需要确定要如何收集测试人员的反馈。You will need to determine how you’d like to collect feedback from your testers. 请考虑提供一个链接,让测试人员能够轻松地通过电子邮件(或反馈中心,如果不存在保密性问题的话)提供反馈。Consider providing a link that lets your testers easily give feedback via email (or via Feedback Hub, if confidentiality is not a concern).
  • 你可以查看应用的分析报告,包括使用情况和运行情况报告以及测试人员留下的任何评级或评论。You can review analytic reports for your app, including usage and health reports and any ratings or reviews left by your testers.
  • 可以在将应用分配到测试人员时包含加载项。You can include add-ons when you distribute your app to testers. 你可能不希望向他们收取某个加载项的费用,因此可以生成促销代码并将它们分发给测试人员,以便他们获取免费的加载项,你也可以在测试期间将加载项的价格设置为免费(然后在将应用提供给其他客户之前,创建一个新的加载项提交以更改其价格)。Since you probably don’t want to charge them money for an add-on, you can generate promotional codes and distribute them to your testers to let them get the add-on for free, or you can set the price for the add-on to Free during testing (then before you make the app available to other customers, create a new submission for the add-on to change its price). 请注意:一个 Microsoft 帐户只能购买每个加载项一次,因此同一测试人员将无法对加载项购买过程进行多次测试。Note that each add-on can only be purchased once per Microsoft account, so the same tester won't be able to test the add-on acquisition process more than one time.
  • 你可以通过创建一个新提交来使用新包随时为测试人员提供应用的更新版本。You can give your testers an updated version of your app at any time by creating a new submission with new packages. 通过认证过程后,测试人员将像获得原始包一样获得更新,但其他人无法获取更新(除非你进行其他更改,例如将应用从私人受众转移为公共受众或更改可以获取更新的组成员)。Your testers will get the update after it goes through the certification process, just like they got the original package, but no one else will be able to get it (unless you make additional changes, such as moving an app from Private audience to Public audience or changing the membership of groups who can get it).

私人受众Private audience

如果你要让测试人员在应用公开发布前就使用它,并确保没有其他人可以看到该应用的一览,请使用可见性(位于你的提交的定价和可用性页面)下的私人受众选项。If you want to let testers use your app before it’s available to others, and make sure that no one else can see its listing, use the Private audience option under Visibility (on the Pricing and availability page of your submission). 只有通过这种方法,才可以在将应用分配给测试人员时,完全防止其他人看到该应用的 Microsoft Store 一览(即使其他人能够键入直接链接)。This is the only method that lets you distribute your app to testers while completely preventing anyone else from seeing the app’s Store listing, even if they were able to type in its direct link.

专用受众选项仅当你没有已发布您的应用程序向公众使用。The Private audience option can only be used when you have not already published your app to a public audience. 可以使用面向任何 OS 版本,应用程序使用此选项,但测试人员必须运行 Windows 10,版本 1607年或更高版本 (包括 Xbox One),并且必须使用与你提供的电子邮件地址相关联的 Microsoft 帐户登录。You can use this option with apps targeting any OS version, but your testers must be running Windows 10, version 1607 or higher (including Xbox One), and must be signed in with the Microsoft account associated with the email address that you provide.

有关详细信息,请参阅私人受众For more info, see Private audience.

软件包外部测试版Package flights

如果你已发布了应用,则可以创建软件包外部测试版来将不同的软件包集分配给指定用户。If you have published your app already, you can create package flights to distribute a different set of packages to the people that you specify. 甚至可以为相同应用创建多个软件包外部测试版,以用于不同组的用户。You can even create multiple package flights for the same app to use with different groups of people. 这是同时尝试不同软件包的绝佳方法,并且如果你决定软件包已准备好分发给所有人,则可以将外部测试版中的软件包加入到非外部测试版提交中。This is a great way to try out different packages simultaneously, and you can pull packages from a flight into your non-flighted submission if you decide the packages are ready to distribute to everyone.

软件包外部测试版适用于面向任何操作系统版本的应用,但测试人员只有在运行 Windows.Desktop 版本 10586 或更高版本、Windows.Mobile 版本 10586.63 或更高版本或 Xbox One 的情况下才可以获得该应用。Package flights can be used with apps targeting any OS version, but your testers can only get the app if they are running Windows.Desktop build 10586 or later; Windows.Mobile build 10586.63 or later; or Xbox One.

有关详细信息,请参阅软件包外部测试版For more info, see Package flights.

在应用商店中隐藏应用和使用促销代码Hiding the app in the Store and using promotional codes

此选项提供了另一种方法来限制到特定组的测试人员的应用的同时防止其他人发现您的应用程序存储区中的分布 (或不使用促销代码获取)。This option offers another way to limit distribution of an app to only a certain group of testers, while preventing anyone else from discovering your app in the Store (or acquiring it without a promotional code). 但是,与私人受众选项不同,如果有直接链接,任何人都可能看到你的应用的一览。However, unlike the private audience option, it could be possible for anyone to see your app’s listing if they have the direct link. 如果保密性对于你的提交至关重要,我们建议改为发布到私人受众。If confidentiality is critical for your submission, we recommend publishing to a private audience instead.

隐藏应用和使用促销代码适用于面向任何操作系统版本的应用,但测试人员只有在运行 Windows 10 的情况下才可以获得该应用。Hiding the app and using promotional codes can be used with apps targeting any OS version, but your testers can only get the app if they are running Windows 10.

要使用此选项,请执行以下操作:To use this option:

  • 定价和可用性页面的可见性部分中,选择可发现性下方的使此产品在 Microsoft Store 中可用,但不可被发现In the Visibility section of the Pricing and availability page, under Discoverability, select Make this product available but not discoverable in the Store. 选择的选项停止获取:任何具有直接链接的客户可以看到该产品的应用商店列表,但如果他们拥有该产品之前,或有促销代码和使用的是 Windows 10 设备,它们可以仅下载它Choose the option for Stop acquisition: Any customer with a direct link can see the product’s Store listing, but they can only download it if they owned the product before, or have a promotional code and are using a Windows 10 device.
  • 应用通过认证后,为应用生成促销代码并分发给测试人员。After the app passes certification, generate promotional codes for the app and distribute them to your testers. 你可以在六个月期间内为单个应用生成最多允许 1600 次兑换的充值码。You can generate codes that allow up to 1600 redemptions for a single app in a six month period. 这些代码将为测试人员提供指向应用一览的直接链接,并且将允许他们免费下载该应用,即使你在创建提交时为其设置了价格。These codes will give your testers a direct link to the app’s listing, and will allow them to download it for free, even if you have set a price for it when you created your submission.
  • 当你准备好向公众提供应用时,请创建一个新提交并将可见性选项更改为使此产品在 Microsoft Store 中可用,并使其可被发现(你也可以更改其他需要改动的内容)。When you're ready to make your app available to the public, create a new submission and change the Visibility option to Make this product available and discoverable in the Store (along with any other changes you'd like).

与上述选项不同,此选项适用于 Windows Phone 8.1 以及 Windows 10 客户(而不适用于 Windows 8.x 客户)。Unlike the options described above, this option works for customers on Windows Phone 8.1 as well as Windows 10 (though not on Windows 8.x). 任何客户都不能通过在 Microsoft Store 中搜索或浏览找到该应用,但如果有 Microsoft Store 一览的直接链接,任何人都可以在运行 Windows Phone 8.1 或更早版本的设备或在 Windows 10 设备上下载它。No customers will be able to find the app by searching or browsing the Store, but anyone with the direct link to its Store listing can download it on a device running Windows Phone 8.1 or earlier, or on Windows 10. 请记住,为了让测试人员免费下载应用,必须将其价格设置为免费Keep in mind that in order for your testers to download the app at no cost, you must set its price to Free.

要使用此选项,请执行以下操作:To use this option:

  • 定价和可用性页面的可见性部分中,选择可发现性下方的使此产品在 Microsoft Store 中可用,但不可被发现In the Visibility section of the Pricing and availability page, under Discoverability, select Make this product available but not discoverable in the Store. 选择的选项仅直接链接:任何具有直接链接到该产品的列表的客户可以上进行下载,除 Windows 8.x。Choose the option for Direct link only: Any customer with a direct link to the product’s listing can download it, except on Windows 8.x..
  • 在发布产品后,将链接(应用标识页面上的 URL)分发给测试人员,以便他们进行试用。After your product has been published, distribute the link (the URL on the App identity page) to your testers so they can try it out.
  • 当你准备好向公众提供应用时,请创建一个新提交并将可见性选项更改为使此产品在 Microsoft Store 中可用,并使其可被发现(你也可以更改其他需要改动的内容)。When you're ready to make your app available to the public, create a new submission and change the Visibility option to Make this product available and discoverable in the Store (along with any other changes you'd like).

重要

自 2018 年 10 月 31 日起,新创建的产品不能包含包面向 Windows Phone 8.x 或更早版本。As of October 31, 2018, newly-created products cannot include packages targeting Windows Phone 8.x or earlier. 有关详细信息,请参阅此博客文章For more info, see this blog post.

向具有指定电子邮件地址的 Windows Phone 客户定向分发Targeted distribution to Windows Phone customers with specified email addresses

重要

此选项不适用于新的提交。This option is not available for new submissions. 如果你之前已经为面向 Windows Phone 8.1 或更早版本的某个应用选择了此选项,你将能够让该应用继续使用此选项。If you had previously selected this option for an app targeting Windows Phone 8.1 or earlier, you will be able to continue to use it for that app. 你可以通过创建新的提交来更改测试人员(最多 10,000 名)列表。You can make changes to the list of testers (up to 10,000) by creating a new submission.

使用此选项,具有你所指定的电子邮件地址的人员可以通过使用应用一览的直接链接来下载该应用(仅限在运行 Windows Phone 8.1 或之前版本的设备上)。With this option, people with the email addresses you specified can download your app (on a device running Windows Phone 8.1 or earlier only) by using the direct link to its listing. 其他任何客户都无法下载该应用(即使他们拥有该链接),并且他们无法通过搜索或浏览在 Microsoft Store 中找到该应用。No other customers will be able to download the app, even if they have the link, and they won't be able to find the app in the Store by searching or browsing. 为了让测试人员能够下载该应用,你需要为他们提供链接(应用标识页面上的 URL),并且他们必须使用与你提供的电子邮件地址相关联的 Microsoft 帐户登录。In order for testers to download the app, you'll need to give them its link (the URL on the App identity page), and they must be signed in with a Microsoft account that is associated with an email address that you provided. 您还可以让应用访问测试人员的 Windows 10 设备上的生成促销代码; 与其中一个应用程序的促销代码的任何人都可以下载它在 Windows 10 设备上,即使您未输入其电子邮件。You can also make the app available for testers on Windows 10 devices by generating promotional codes; anyone with one of your app's promotional codes can download it on a Windows 10 device, even if you didn't enter their email here.