Azure Data Lake

Azure Data Lake

Azure Data Lake Store connector allows you to read and add data to an Azure Data Lake account.

This connector is available in the following products and regions:

Service Class Regions
Logic Apps Standard All Logic Apps regions except the following:
     -   Azure Government regions
     -   Azure China regions
Flow Standard All Flow regions except the following:
     -   US Government (GCC)
PowerApps Standard All PowerApps regions except the following:
     -   US Government (GCC)

To use this integration, you will need an Azure Data Lake Storage Gen1 account. You can create account in 3 ways: use Azure PowerShell; use Azure CLI; use Azure portal. For more information, see Get started.

Known Issues and Limitations

  • The connector support Azure Data Lake GEN1.
  • The Azure Data Lake limitations are documented here.

Throttling Limits

Name Calls Renewal Period
API calls per connection 3600 60 seconds
Frequency of trigger polls 1 15 seconds

Creating a connection

To connect your account, you will need the following information:

Client ID
string
Client (or Application) ID of the Azure Active Directory application.
Client Secret
securestring
Client secret of the Azure Active Directory application.
Tenant
string
The tenant ID of for the Azure Active Directory application.
ResourceUri
string
The resource you are requesting authorization to use.
Grant Type
string
Grant type

Actions

Append File (concurrent)

Concurrent append to a file.

Required Parameters

Account name
string
Account name for Azure Data Lake.
File path
string
Path of the file (no leading '/').
Content
binary
Content of the file

Optional Parameters

Append mode
string
Set to auto-create if path doesn't exist.

Returns

Operation message
string

Append File (sequential)

Append to a file serially.

Required Parameters

Account name
string
Account name for Azure Data Lake.
File path
string
Path of the file (no leading '/').
Content
binary
Content to append

Optional Parameters

Offset
integer
The optional offset in the stream to begin the append operation. Default is to append at the end of the stream.

Returns

Create Folder

Create a folder in a Data Lake Store account.

Required Parameters

Account name
string
Account name for Azure Data Lake.
Folder path
string
Path of the folder to create (no leading '/').

Returns

Delete File

Delete a file from a Data Lake Store account.

Required Parameters

Account name
string
Account name for Azure Data Lake.
File path
string
Path of the file (no leading '/').

Returns

List Files

List files and folders in a Data Lake Store account.

Required Parameters

Account name
string
Account name for Azure Data Lake.

Optional Parameters

Folder path
string
Path of the folder (no leading '/').

Returns

Read File

Read data from a Data Lake Store account.

Required Parameters

Account name
string
Account name for Azure Data Lake.
File path
string
Path of the file (no leading '/').

Returns

File content
binary

Upload File

Upload data into a Data Lake Store account.

Required Parameters

Account name
string
Account name for Azure Data Lake.
File path
string
Path of the file (no leading '/').
Content
binary
Content of the file

Optional Parameters

Overwrite
boolean
Overwrite if existing file.

Returns

Operation message
string

Definitions

folderResponse

FileStatus
fileStatusArray
FileStatus

fileStatusArray

FileStatus

Access Time
integer
Unix (Epoch) time when the item last accessed.
Block Size
integer
Block size of folder or file.
File name
string
File or folder name.
Modification Time
integer
Unix (Epoch) time when the item last modified.
Type
string
Type of item (directory or file).

operationPerformed

Is Successful
boolean
Flag if the last operation was successful.