您现在访问的是微软AZURE全球版技术文档网站,若需要访问由世纪互联运营的MICROSOFT AZURE中国区技术文档网站,请访问 https://docs.azure.cn.

使用“监视和管理”应用监视和管理 Azure 数据工厂管道Monitor and manage Azure Data Factory pipelines by using the Monitoring and Management app

备注

本文适用于数据工厂版本 1。This article applies to version 1 of Data Factory. 如果使用数据工厂服务的当前版本,请参阅监视和管理数据工厂管道If you are using the current version of the Data Factory service, see monitor and manage Data Factory pipelines in.

本文介绍如何使用“监视和管理”应用监视、管理和调试数据工厂管道。This article describes how to use the Monitoring and Management app to monitor, manage, and debug your Data Factory pipelines. 可以通过观看以下视频开始使用该应用程序:You can get started with using the application by watching the following video:

备注

视频中所示的用户界面可能与门户中看到的内容不完全匹配。The user interface shown in the video may not exactly match what you see in the portal. 它略显陈旧,但概念保持不变。It's slightly older, but concepts remain the same.

启动“监视和管理”应用Launch the Monitoring and Management app

若要启动“监视和管理”应用,请针对数据工厂单击“数据工厂”边栏选项卡上的“监视和管理”磁贴。To launch the Monitor and Management app, click the Monitor & Manage tile on the Data Factory blade for your data factory.

数据工厂主页上的“监视”磁贴

可以看到“监视和管理”应用在单独的窗口中打开。You should see the Monitoring and Management app open in a separate window.

“监视和管理”应用

备注

如果 Web 浏览器停滞在“正在授权...”处,请清除“阻止第三方 Cookie 和站点数据”复选框,或在将其保持选中的状态下为 login.microsoftonline.com 创建一个例外,并尝试再次打开该应用。If you see that the web browser is stuck at "Authorizing...", clear the Block third-party cookies and site data check box--or keep it selected, create an exception for login.microsoftonline.com, and then try to open the app again.

在中间窗格中的“活动窗口”列表中,每次运行某个活动时,都可以看到一个活动窗口。In the Activity Windows list in the middle pane, you see an activity window for each run of an activity. 例如,如果将该活动计划为在五小时内每小时运行一次,将看到与五个数据切片关联的五个活动窗口。For example, if you have the activity scheduled to run hourly for five hours, you see five activity windows associated with five data slices. 如果在底部列表中看不到活动窗口,请执行以下操作:If you don't see activity windows in the list at the bottom, do the following:

  • 更新顶部的“开始时间”和“结束时间”筛选器以匹配管道的开始时间和结束时间,然后单击“应用”按钮。Update the start time and end time filters at the top to match the start and end times of your pipeline, and then click the Apply button.
  • “活动窗口”列表不会自动刷新。The Activity Windows list is not automatically refreshed. 请单击“活动窗口”列表中工具栏上的“刷新”按钮。Click the Refresh button on the toolbar in the Activity Windows list.

如果没有用于测试这些步骤的数据工厂应用程序,请完成教程:使用数据工厂将数据从 Blob 存储复制到 SQL 数据库If you don't have a Data Factory application to test these steps with, do the tutorial: copy data from Blob Storage to SQL Database using Data Factory.

了解“监视和管理”应用Understand the Monitoring and Management app

左侧有三个选项卡:“资源浏览器”、“监视视图”和“警报”。There are three tabs on the left: Resource Explorer, Monitoring Views, and Alerts. 第一个选项卡(资源浏览器)在默认情况下处于选中状态。The first tab (Resource Explorer) is selected by default.

资源浏览器Resource Explorer

会看到如下内容:You see the following:

  • 左侧窗格中的资源浏览器 树视图The Resource Explorer tree view in the left pane.
  • 中间窗格顶部的 图示视图The Diagram View at the top in the middle pane.
  • 中间窗格底部的“活动窗口”列表。The Activity Windows list at the bottom in the middle pane.
  • 右侧窗格中的“属性”、“活动窗口资源管理器”和“脚本”选项卡。The Properties, Activity Window Explorer, and Script tabs in the right pane.

在资源浏览器中,可在树视图的数据工厂中查看所有资源(管道、数据集、链接服务)。In Resource Explorer, you see all resources (pipelines, datasets, linked services) in the data factory in a tree view. 在资源浏览器中选择对象时:When you select an object in Resource Explorer:

  • 图示视图中将突出显示相关的数据工厂实体。The associated Data Factory entity is highlighted in the Diagram View.
  • “活动窗口”列表中将突出显示相关的活动窗口Associated activity windows are highlighted in the Activity Windows list at the bottom.
  • 右侧窗格的“属性”窗口中会显示所选对象的属性。The properties of the selected object are shown in the Properties window in the right pane.
  • 将显示所选对象的 JSON 定义(如果适用)。The JSON definition of the selected object is shown, if applicable. 例如:链接服务、数据集或管道。For example: a linked service, a dataset, or a pipeline.

资源浏览器

有关活动窗口的详细概念性信息,请参阅计划和执行一文。See the Scheduling and Execution article for detailed conceptual information about activity windows.

图示视图Diagram View

数据工厂的图示视图提供单个窗格来监视和管理数据工厂及其资产。The Diagram View of a data factory provides a single pane of glass to monitor and manage a data factory and its assets. 在图示视图中选择数据工厂实体(数据集/管道)时:When you select a Data Factory entity (dataset/pipeline) in the Diagram View:

  • 数据工厂实体会在树视图中处于选中状态。The data factory entity is selected in the tree view.
  • “活动窗口”列表中将突出显示相关的活动窗口。The associated activity windows are highlighted in the Activity Windows list.
  • “属性”窗口中会显示所选对象的属性。The properties of the selected object are shown in the Properties window.

管道已启用(不处于暂停状态)时,将使用绿线显示管道:When the pipeline is enabled (not in a paused state), it's shown with a green line:

正在运行的管道

通过在图示视图中选择管道并使用命令栏上的按钮,可以暂停、恢复或终止管道。You can pause, resume, or terminate a pipeline by selecting it in the diagram view and using the buttons on the command bar.

命令栏上的“暂停”/“恢复”

图示视图中有三个用于管道的命令栏按钮。There are three command bar buttons for the pipeline in the Diagram View. 可以使用第二个按钮暂停管道。You can use the second button to pause the pipeline. 暂停不会终止当前正在运行的活动,而是会允许其继续完成。Pausing doesn't terminate the currently running activities and lets them proceed to completion. 第三个按钮暂停管道并终止其现有的执行活动。The third button pauses the pipeline and terminates its existing executing activities. 第一个按钮恢复管道。The first button resumes the pipeline. 暂停管道后,管道的颜色将改变。When your pipeline is paused, the color of the pipeline changes. 例如,暂停的管道如下图中所示:For example, a paused pipeline looks like in the following image:

暂停的管道

可以通过使用 Ctrl 键对两个或更多管道进行多选。You can multi-select two or more pipelines by using the Ctrl key. 可以使用命令栏按钮来同时暂停/恢复多个管道。You can use the command bar buttons to pause/resume multiple pipelines at a time.

还可以右键单击管道,然后选择相应选项以暂停、恢复或终止管道。You can also right-click a pipeline and select options to suspend, resume, or terminate a pipeline.

管道的上下文菜单

单击“打开管道”选项可查看管道中的所有活动。Click the Open pipeline option to see all the activities in the pipeline.

“打开管道”菜单

在打开的管道视图中,可以看到管道中的所有活动。In the opened pipeline view, you see all activities in the pipeline. 在此示例中,只有一个活动:复制活动。In this example, there is only one activity: Copy Activity.

打开的管道

若要返回到上一视图,请单击顶部痕迹菜单中的数据工厂名称。To go back to the previous view, click the data factory name in the breadcrumb menu at the top.

在管道视图中,选择输出数据集或将鼠标悬停在输出数据集上时,可以看到该数据集的“活动窗口”弹出窗口。In the pipeline view, when you select an output dataset or when you move your mouse over the output dataset, you see the Activity Windows pop-up window for that dataset.

“活动窗口”弹出窗口

可以在右侧窗格的“属性”窗口中单击活动窗口以查看其详细信息。You can click an activity window to see details for it in the Properties window in the right pane.

“活动窗口”属性

在右侧窗格中,切换到“活动窗口资源管理器”选项卡以查看更多详细信息。In the right pane, switch to the Activity Window Explorer tab to see more details.

显示如何访问 "活动窗口资源管理器" 选项卡的屏幕截图。

还可在“尝试”部分看到活动的每次运行尝试的 已解析变量You also see resolved variables for each run attempt for an activity in the Attempts section.

已解析变量

切换到“脚本”选项卡以查看所选对象的 JSON 脚本定义。Switch to the Script tab to see the JSON script definition for the selected object.

脚本选项卡

可在三处看到活动窗口:You can see activity windows in three places:

  • 图示视图(中间窗格)中的“活动窗口”弹出窗口。The Activity Windows pop-up in the Diagram View (middle pane).
  • 右侧窗格中的“活动窗口资源管理器”。The Activity Window Explorer in the right pane.
  • 底部窗格中的“活动窗口”列表。The Activity Windows list in the bottom pane.

在“活动窗口”弹出窗口和“活动窗口资源管理器”中,可使用向左、向右键滚动到上一周和下一周。In the Activity Windows pop-up and Activity Window Explorer, you can scroll to the previous week and the next week by using the left and right arrows.

活动窗口资源管理器向左/向右键

在图示视图底部,可看到这些按钮:放大、缩小、缩放到合适大小、比例 100%、锁定布局。At the bottom of the Diagram View, you see these buttons: Zoom In, Zoom Out, Zoom to Fit, Zoom 100%, Lock layout. “锁定布局”按钮将防止意外移动图示视图中的表和管道。The Lock layout button prevents you from accidentally moving tables and pipelines in the Diagram View. 它在默认情况下处于“打开”状态。It's on by default. 可将其关闭,还可在图示中移动实体。You can turn it off and move entities around in the diagram. 将其关闭后,可使用最后一个按钮来自动放置表和管道。When you turn it off, you can use the last button to automatically position tables and pipelines. 还可以通过使用鼠标滚轮来放大或缩小。You can also zoom in or out by using the mouse wheel.

图示视图缩放命令

“活动窗口”列表Activity Windows list

中间窗格底部的“活动窗口”列表显示资源浏览器或图示视图中所选数据集的所有活动窗口。The Activity Windows list at the bottom of the middle pane displays all activity windows for the dataset that you selected in the Resource Explorer or the Diagram View. 默认情况下,该列表按降序排序,这意味着可在顶部看到最新的活动窗口。By default, the list is in descending order, which means that you see the latest activity window at the top.

“活动窗口”列表

此列表不会自动刷新,因此请使用工具栏上的刷新按钮进行手动刷新。This list doesn't refresh automatically, so use the refresh button on the toolbar to manually refresh it.

活动窗口可处于以下任一状态:Activity windows can be in one of the following statuses:

状态Status子状态Substatus说明Description
等待WaitingScheduleTimeScheduleTime未到运行活动窗口的时间。The time hasn't come for the activity window to run.
DatasetDependenciesDatasetDependencies上游依赖项未准备就绪。The upstream dependencies aren't ready.
ComputeResourcesComputeResources计算资源不可用。The compute resources aren't available.
ConcurrencyLimitConcurrencyLimit 所有活动实例都忙于运行其他活动窗口。All the activity instances are busy running other activity windows.
ActivityResumeActivityResume活动暂停,且在恢复活动之前无法运行活动窗口。The activity is paused and can't run the activity windows until it's resumed.
重试Retry正在重试活动执行。The activity execution is being retried.
验证Validation验证尚未开始。Validation hasn't started yet.
ValidationRetryValidationRetry验证正在等待重试。Validation is waiting to be retried.
正在进行InProgress正在验证Validating正在进行验证。Validation is in progress.
- 正在处理活动窗口。The activity window is being processed.
已失败Failed已超时TimedOut活动执行时间超过活动允许的时间。The activity execution took longer than what is allowed by the activity.
已取消Canceled用户操作已取消活动窗口。The activity window was canceled by user action.
验证Validation验证失败。Validation has failed.
-未能生成和/或验证活动窗口。The activity window failed to be generated or validated.
就绪Ready-活动窗口已就绪,可供使用。The activity window is ready for consumption.
已跳过Skipped-未处理活动窗口。The activity window wasn't processed.
None-过去一直以不同状态存在但已被重置的活动窗口。An activity window used to exist with a different status, but has been reset.

单击列表中的活动窗口时,可在右侧的“活动窗口资源管理器”或“属性”窗口中看到其详细信息。When you click an activity window in the list, you see details about it in the Activity Windows Explorer or the Properties window on the right.

显示如何查看有关活动窗口的详细信息的屏幕截图。

刷新活动窗口Refresh activity windows

详细信息不会自动刷新,因此请使用命令栏上的“刷新”按钮(第二个按钮)手动刷新活动窗口列表。The details aren't automatically refreshed, so use the refresh button (the second button) on the command bar to manually refresh the activity windows list.

“属性”窗口Properties window

属性窗口位于监视和管理应用的最右侧窗格中。The Properties window is in the right-most pane of the Monitoring and Management app.

“属性”窗口

它会显示资源浏览器(树视图)、图示视图或“活动窗口”列表中所选项的属性。It displays properties for the item that you selected in the Resource Explorer (tree view), Diagram View, or Activity Windows list.

活动窗口资源管理器Activity Window Explorer

" 活动窗口资源管理器 " 窗口位于 "监视和管理" 应用的最右侧窗格中。The Activity Window Explorer window is in the right-most pane of the Monitoring and Management app. 它显示“活动窗口”弹出窗口或“活动窗口”列表中所选活动窗口的相关详细信息。It displays details about the activity window that you selected in the Activity Windows pop-up window or the Activity Windows list.

活动窗口资源管理器

通过在顶部日历视图中单击活动窗口资源管理器,可切换到另一活动窗口。You can switch to another activity window by clicking it in the calendar view at the top. 还可使用顶部的向左键/向右键按钮查看上周或下周的活动窗口。You can also use the left arrow/right arrow buttons at the top to see activity windows from the previous week or the next week.

在底部窗格中,可使用工具栏按钮来重新运行活动窗口或刷新窗格中的详细信息。You can use the toolbar buttons in the bottom pane to rerun the activity window or refresh the details in the pane.

脚本Script

可以使用“脚本”选项卡来查看所选数据工厂实体(链接服务、数据集或管道)的 JSON 定义。You can use the Script tab to view the JSON definition of the selected Data Factory entity (linked service, dataset, or pipeline).

脚本选项卡

使用系统视图Use system views

使用“监视和管理”应用附带的预建系统视图(“最近活动窗口”、“失败活动窗口”、“进行中活动窗口”),可以查看数据工厂的最近/失败/进行中活动窗口。The Monitoring and Management app includes pre-built system views (Recent activity windows, Failed activity windows, In-Progress activity windows) that allow you to view recent/failed/in-progress activity windows for your data factory.

通过单击左侧“监视视图”选项卡切换到此视图。Switch to the Monitoring Views tab on the left by clicking it.

监视视图选项卡

目前有三种系统视图受支持。Currently, there are three system views that are supported. 选择一个选项可在“活动窗口”列表(位于中间窗格底部)中查看最近活动窗口、失败活动窗口或进行中活动窗口。Select an option to see recent activity windows, failed activity windows, or in-progress activity windows in the Activity Windows list (at the bottom of the middle pane).

选择“最近活动窗口”选项时,将看到按 上次尝试时间 降序排序的所有最近活动窗口。When you select the Recent activity windows option, you see all recent activity windows in descending order of the last attempt time.

可以使用“失败活动窗口”视图来查看列表中所有失败的活动窗口。You can use the Failed activity windows view to see all failed activity windows in the list. 在该列表中选择失败活动窗口,可在“属性”窗口或“活动窗口资源管理器”中查看其详细信息。Select a failed activity window in the list to see details about it in the Properties window or the Activity Window Explorer. 还可以下载失败活动窗口的任何日志。You can also download any logs for a failed activity window.

排序并筛选活动窗口Sort and filter activity windows

更改命令栏中的“开始时间”和“结束时间”设置,以筛选活动窗口。Change the start time and end time settings in the command bar to filter activity windows. 更改开始时间和结束时间后,单击结束时间旁边的按钮可刷新“活动窗口”列表。After you change the start time and end time, click the button next to the end time to refresh the Activity Windows list.

开始和结束时间

备注

目前,“监视和管理”应用中的所有时间均采用 UTC 格式。Currently, all times are in UTC format in the Monitoring and Management app.

在“活动窗口”列表中,单击某一列的名称(例如:状态)。In the Activity Windows list, click the name of a column (for example: Status).

“活动窗口”列表列菜单

您可以执行下列操作:You can do the following:

  • 按升序排序。Sort in ascending order.
  • 按降序排序。Sort in descending order.
  • 按一个或多个值(“就绪”、“等待”等)筛选。Filter by one or more values (Ready, Waiting, and so on).

对列指定筛选器时,将看到为该列启用的筛选器按钮,该按钮指示列中的值为已筛选值。When you specify a filter on a column, you see the filter button enabled for that column, which indicates that the values in the column are filtered values.

“活动窗口”列表的列的筛选器

可以使用相同的弹出窗口来清除筛选器。You can use the same pop-up window to clear filters. 若要清除“活动窗口”列表的所有筛选器,请单击命令栏上的清除筛选器按钮。To clear all filters for the Activity Windows list, click the clear filter button on the command bar.

清除“活动窗口”列表的所有筛选器

执行批处理操作Perform batch actions

重新运行选定的活动窗口Rerun selected activity windows

选择一个活动窗口,单击第一个命令栏按钮的向下箭头,然后选择 "重新运行 / 管道中的上游"。Select an activity window, click the down arrow for the first command bar button, and select Rerun / Rerun with upstream in pipeline. 选择“与管道中的上游一起重新运行”选项时,也将重新运行所有上游活动窗口。When you select the Rerun with upstream in pipeline option, it reruns all upstream activity windows as well. 重新运行活动窗口Rerun an activity window

还可在列表中选择多个活动窗口,并同时重新运行它们。You can also select multiple activity windows in the list and rerun them at the same time. 可能希望基于状态筛选活动窗口(例如:失败),并在解决导致活动窗口失败的问题后重新运行失败的活动窗口。You might want to filter activity windows based on the status (for example: Failed)--and then rerun the failed activity windows after correcting the issue that causes the activity windows to fail. 有关在列表中筛选活动窗口的详细信息,请参阅以下部分。See the following section for details about filtering activity windows in the list.

暂停/恢复多个管道Pause/resume multiple pipelines

可以通过使用 Ctrl 键对两个或更多管道进行多选。You can multiselect two or more pipelines by using the Ctrl key. 可以使用命令栏按钮(在下图的红色矩形中突出显示)来暂停/恢复它们。You can use the command bar buttons (which are highlighted in the red rectangle in the following image) to pause/resume them.

命令栏上的“暂停”/“恢复”