Test: Xamarin Test Cloud

VSTS | TFS 2018 | TFS 2017 | TFS 2015

Test mobile apps with Xamarin Test Cloud using Xamarin.UITest

NOTE: This task is deprecated. Use the App Center Test task instead.




Argument Description
App File - If you want to test a single app, choose ... and select the .apk file.
- If you want to test multiple apps, specify a match pattern filter. You can use a single-folder wildcard (*) and recursive wildcards (**). For example, **/*.apk searches for all .apk files in all subdirectories.
dSYM File To make crash logs easier to read, upload a .dSYM file that is associated with your app. Specify a path relative to the .ipa file. You can use a match pattern filter. For example: *.dSYM
Note: This argument applies only to iOS apps.
Team API Key Your Xamarin Test Cloud Team API key. To get it, go to your Xamarin Test Cloud account, and then to Teams & Apps.
Important: Use a secret variable to avoid exposing this value.
User Email Email address of your Xamarin Test Cloud account.
Devices The devices string generated by Xamarin Test Cloud. To get this string:
- Go to your Xamarin Test Cloud account.
- Choose New Test Run.
- Step through the wizard.
- When you reach the final page, copy the ID that follows the --devices option.
Series Series name for the test run. For example, master, production, or beta. See Xamarin: Creating A Test Run for a Team.
Test Assembly Directory Relative path to the folder that contains the test assemblies. For example: SolutionName/TestsProjectName/bin/Release.
Advanced - Parallelization Select None, By test fixture, or By test method.
Advanced - System Language Select your language. If it isn't displayed, select Other and then enter its locale below. For example: en_AU.
Advanced - test-cloud.exe Location Location of test-cloud.exe. In most cases leave this set to the default value.
Advanced - Optional Arguments (Optional) Arguments passed to test-cloud.exe. See Submitting UITests at the Command Line.
Advanced - Publish results to VSO/TFS Select if you want to pass the --nunit-xml option to test-cloud.exe so that results from the NUnit xml file are be published to TFS or VSTS.
Control options See Control options

YAML snippet


- task: XamarinTestCloud@1
#   series: master
#   parallelizationOption: none # none (default), --fixture-chunk, --test-chunk
#   localeOption: en_US # da_DK, nl_NL, en_GB, en_US (default), fr_FR, de_DE, ja_JP, ru_RU, es_MX, es_ES, user
#   testCloudFile: **/packages/**/tools/test-cloud.exe
#   publishNUnitResults: true


Build your Xamarin app


How do I add a Xamarin UITest to my solution?

Adding Xamarin.UITest to a Solution

Where can I learn more about file matching patterns?

File matching patterns reference

Do I need an agent?

You need at least one agent to run your build or release. Get an agent.

I can't select a default agent queue and I can't queue my build or release. How do I fix this?

See Agent pools and queues.

I use TFS on-premises and I don't see some of these features. Why not?

Some of these features are available only on VSTS and not yet available on-premises. Some features are available on-premises if you have upgraded to the latest version of TFS.