Learn how to troubleshoot U-SQL runtime failures due to runtime changes

The Azure Data Lake U-SQL runtime, including the compiler, optimizer, and job manager, is what processes your U-SQL code.

Choosing your U-SQL runtime version

When you submit U-SQL jobs from either Visual Studio, the ADL SDK or the Azure Data Lake Analytics portal, your job will use the currently available default runtime. New versions of the U-SQL runtime are released on a regular basis and include both minor updates and security fixes.

You can also choose a custom runtime version; either because you want to try out a new update, need to stay on an older version of a runtime, or were provided with a hotfix for a reported problem where you cannot wait for the regular new update.

Caution

Choosing a runtime that is different from the default has the potential to break your U-SQL jobs. Use these other versions for testing only.

In rare cases, Microsoft Support may pin a different version of a runtime as the default for your account. Please ensure that you revert this pin as soon as possible. If you remain pinned to that version, it will expire at some later date.

Monitoring your jobs U-SQL runtime version

You can see the history of which runtime version your past jobs have used in your account’s job history via the Visual Studio’s job browser or the Azure portal’s job history.

  1. In the Azure portal, go to your Data Lake Analytics account.
  2. Select View All Jobs. A list of all the active and recently finished jobs in the account appears.
  3. Optionally, click Filter to help you find the jobs by Time Range, Job Name, and Author values.
  4. You can see the runtime used in the completed jobs.

Displaying the runtime version of a past job

The available runtime versions change over time. The default runtime is always called “default” and we keep at least the previous runtime available for some time as well as make special runtimes available for a variety of reasons. Explicitly named runtimes generally follow the following format (italics are used for variable parts and [] indicates optional parts):

release_YYYYMMDD_adl_buildno[_modifier]

For example, release_20190318_adl_3394512_2 means the second version of the build 3394512 of the runtime release of March 18 2019 and release_20190318_adl_3394512_private means a private build of the same release. Note: The date is related to when the last check-in has been taken for that release and not necessarily the official release date.

The following are the currently available runtime versions.

  • release_20190318_adl_3394512
  • release_20190318_adl_5832669 the current default
  • release_20190703_adl_4713356

Troubleshooting U-SQL runtime version issues

There are two possible runtime version issues that you may encounter:

  1. A script or some user-code is changing behavior from one release to the next. Such breaking changes are normally communicated ahead of time with the publication of release notes. If you encounter such a breaking change, please contact Microsoft Support to report this breaking behavior (in case it has not been documented yet) and submit your jobs against the older runtime version.

  2. You have been using a non-default runtime either explicitly or implicitly when it has been pinned to your account, and that runtime has been removed after some time. If you encounter missing runtimes, please upgrade your scripts to run with the current default runtime. If you need additional time, please contact Microsoft Support

See also