Azure Data Factory - .NET API change log

Note

This article applies to version 1 of Data Factory, which is generally available (GA).

This article provides information about changes to Azure Data Factory SDK in a specific version. You can find the latest NuGet package for Azure Data Factory here

Version 4.11.0

Feature Additions:

Version 4.10.0

Version 4.9.1

Bug fix

Version 4.9.0

Feature Additions

Bug fix

Version 4.8.0

Feature Additions

Version 4.7.0

Feature Additions

  • Added new StorageFormat type OrcFormat type to copy files in optimized row columnar (ORC) format.
  • Add AllowPolyBase and PolyBaseSettings properties to SqlDWSink.
    • Enables the use of PolyBase to copy data into SQL Data Warehouse.

Version 4.6.1

Bug Fixes

  • Fixes HTTP request for listing activity windows.
    • Removes the resource group name and the data factory name from the request payload.

Version 4.6.0

Feature Additions

Version 4.5.0

Feature Additions

Version 4.4.0

Feature additions

Version 4.3.0

Feature additions

Version 4.2.0

Feature additions

Version 4.1.0

Feature additions

Version 4.0.1

Breaking changes

The following classes have been renamed. The new names were the original names of classes before 4.0.0 release.

Name in 4.0.0 Name in 4.0.1
AzureSqlDataWarehouseDataset AzureSqlDataWarehouseTableDataset
AzureSqlDataset AzureSqlTableDataset
AzureDataset AzureTableDataset
OracleDataset OracleTableDataset
RelationalDataset RelationalTableDataset
SqlServerDataset SqlServerTableDataset

Version 4.0.0

Breaking changes

  • The Following classes/interfaces have been renamed.
Old name New name
ITableOperations IDatasetOperations
Table Dataset
TableProperties DatasetProperties
TableTypeProprerties DatasetTypeProperties
TableCreateOrUpdateParameters DatasetCreateOrUpdateParameters
TableCreateOrUpdateResponse DatasetCreateOrUpdateResponse
TableGetResponse DatasetGetResponse
TableListResponse DatasetListResponse
CreateOrUpdateWithRawJsonContentParameters DatasetCreateOrUpdateWithRawJsonContentParameters
  • The List methods return paged results now. If the response contains a non-empty NextLink property, the client application needs to continue fetching the next page until all pages are returned. Here is an example:

    PipelineListResponse response = client.Pipelines.List("ResourceGroupName", "DataFactoryName");
    var pipelines = new List<Pipeline>(response.Pipelines);
    
    string nextLink = response.NextLink;
    while (!string.IsNullOrEmpty(nextLink))
    {
        PipelineListResponse nextResponse = client.Pipelines.ListNext(nextLink);
        pipelines.AddRange(nextResponse.Pipelines);
    
        nextLink = nextResponse.NextLink;
    }
    
  • List pipeline API returns only the summary of a pipeline instead of full details. For instance, activities in a pipeline summary only contain name and type.

Feature additions

  • The SqlDWSink class supports two new properties, SliceIdentifierColumnName and SqlWriterCleanupScript, to support idempotent copy to Azure SQL Data Warehouse. See the Azure SQL Data Warehouse article for details about these properties.
  • We now support running stored procedure against Azure SQL Database and Azure SQL Data Warehouse sources as part of the Copy Activity. The SqlSource and SqlDWSource classes have the following properties: SqlReaderStoredProcedureName and StoredProcedureParameters. See the Azure SQL Database and Azure SQL Data Warehouse articles on Azure.com for details about these properties.