Az.DataFactory

Azure Data Factory V2 is the data integration platform that goes beyond Azure Data Factory V1's orchestration and batch-processing of time-series log data, with a general purpose app model supporting modern data warehousing patterns and scenarios, lift-and-shift SSIS, and data-driven SaaS applications. Compose and manage reliable and secure data integration workflows at scale. Use native ADF data connectors and Integration Runtimes to move and transform cloud and on-premises data that can be unstructured, semi-structured, and structured with Hadoop, Azure Data Lake, Spark, SQL Server, Cosmos DB and many other data platforms.

Data Factories

Get-AzDataFactory

Gets information about Data Factories.

Get-AzDataFactoryActivityWindow

Gets information about activity windows associated with a data factory.

Get-AzDataFactoryDataset

Gets information about datasets in Azure Data Factory.

Get-AzDataFactoryGateway

Gets information about logical gateways in Azure Data Factory.

Get-AzDataFactoryGatewayAuthKey

Gets gateway auth key for an Azure Data Factory.

Get-AzDataFactoryHub

Gets information about hubs in Azure Data Factory.

Get-AzDataFactoryLinkedService

Gets information about linked services in Azure Data Factory.

Get-AzDataFactoryPipeline

Gets information about pipelines in Azure Data Factory.

Get-AzDataFactoryRun

Gets runs for a data slice of a dataset in Azure Data Factory.

Get-AzDataFactorySlice

Gets data slices for a dataset in Azure Data Factory.

Get-AzDataFactoryV2

Gets information about Data Factory.

Get-AzDataFactoryV2ActivityRun

Gets information about activity runs for a pipeline run.

Get-AzDataFactoryV2Dataset

Gets information about datasets in Data Factory.

Get-AzDataFactoryV2IntegrationRuntime

Gets information about integration runtime resources.

Get-AzDataFactoryV2IntegrationRuntimeKey

Gets keys for a self-hosted integration runtime.

Get-AzDataFactoryV2IntegrationRuntimeMetric

Gets metric data for an integration runtime.

Get-AzDataFactoryV2IntegrationRuntimeNode

Gets an integration runtime node infomation.

Get-AzDataFactoryV2LinkedService

Gets information about linked services in Data Factory.

Get-AzDataFactoryV2Pipeline

Gets information about pipelines in Data Factory.

Get-AzDataFactoryV2PipelineRun

Gets information about pipeline runs.

Get-AzDataFactoryV2Trigger

Gets information about triggers in a data factory.

Get-AzDataFactoryV2TriggerRun

Returns information about trigger runs.

Invoke-AzDataFactoryV2IntegrationRuntimeUpgrade

Upgrades self-hosted integration runtime.

Invoke-AzDataFactoryV2Pipeline

Invokes a pipeline to start a run for it.

New-AzDataFactory

Creates a data factory.

New-AzDataFactoryDataset

Creates a dataset in Data Factory.

New-AzDataFactoryEncryptValue

Encrypts sensitive data.

New-AzDataFactoryGateway

Creates a gateway for an Azure Data Factory.

New-AzDataFactoryGatewayAuthKey

Creates auth key for an Azure Data Factory Gateway.

New-AzDataFactoryHub

Creates a hub for an Azure Data Factory.

New-AzDataFactoryLinkedService

Links a data store or a cloud service to an Azure Data Factory.

New-AzDataFactoryPipeline

Creates a pipeline in Data Factory.

New-AzDataFactoryV2IntegrationRuntimeKey

Regenerate self-hosted integration runtime key.

New-AzDataFactoryV2LinkedServiceEncryptedCredential

Encrypt credential in linked service with specified integration runtime.

Remove-AzDataFactory

Removes a data factory.

Remove-AzDataFactoryDataset

Removes a dataset from Azure Data Factory.

Remove-AzDataFactoryGateway

Removes a gateway from Azure Data Factory.

Remove-AzDataFactoryHub

Removes a hub from Azure Data Factory.

Remove-AzDataFactoryLinkedService

Removes a linked service from Azure Data Factory.

Remove-AzDataFactoryPipeline

Removes a pipeline from Azure Data Factory.

Remove-AzDataFactoryV2

Removes a data factory.

Remove-AzDataFactoryV2Dataset

Removes a dataset from Data Factory.

Remove-AzDataFactoryV2IntegrationRuntime

Removes an integration runtime.

Remove-AzDataFactoryV2IntegrationRuntimeNode

Remove a node with the given name on an integration runtime.

Remove-AzDataFactoryV2LinkedService

Removes a linked service from Data Factory.

Remove-AzDataFactoryV2Pipeline

Removes a pipeline from Data Factory.

Remove-AzDataFactoryV2Trigger

Removes a trigger from a data factory.

Resume-AzDataFactoryPipeline

Resumes a suspended pipeline in Data Factory.

Save-AzDataFactoryLog

Downloads log files from Azure HDInsight processing.

Set-AzDataFactoryGateway

Sets the description for a gateway in Azure Data Factory.

Set-AzDataFactoryPipelineActivePeriod

Configures the active period for data slices.

Set-AzDataFactorySliceStatus

Sets the status of slices for a dataset in Azure Data Factory.

Set-AzDataFactoryV2

Creates a data factory.

Set-AzDataFactoryV2Dataset

Creates a dataset in Data Factory.

Set-AzDataFactoryV2IntegrationRuntime

Updates an integration runtime.

Set-AzDataFactoryV2LinkedService

Links a data store or a cloud service to Data Factory.

Set-AzDataFactoryV2Pipeline

Creates a pipeline in Data Factory.

Set-AzDataFactoryV2Trigger

Creates a trigger in a data factory.

Start-AzDataFactoryV2IntegrationRuntime

Starts a managed dedicated integration runtime.

Start-AzDataFactoryV2Trigger

Starts a trigger in a data factory.

Stop-AzDataFactoryV2IntegrationRuntime

Stops a managed dedicated integration runtime.

Stop-AzDataFactoryV2PipelineRun

Stops a pieline run in a data factory.

Stop-AzDataFactoryV2Trigger

Stops a trigger in a data factory.

Suspend-AzDataFactoryPipeline

Suspends a pipeline in Azure Data Factory.

Sync-AzDataFactoryV2IntegrationRuntimeCredential

Synchronizes credentials among integration runtime nodes.

Update-AzDataFactoryV2

Updates the properties of a data factory.

Update-AzDataFactoryV2IntegrationRuntime

Updates an integration runtime.

Update-AzDataFactoryV2IntegrationRuntimeNode

Updates self-hosted integration runtime node.