Azure Data Lake

  • Reference

Azure Data Lake Store connector allows you to read and add data to an Azure Data Lake account.

This connector is available in the following products and regions:

Service Class Regions
Logic Apps Standard All Logic Apps regions except the following:
     -   Azure Government regions
     -   Azure China regions
     -   US Department of Defense (DoD)
Power Automate Premium All Power Automate regions except the following:
     -   US Government (GCC)
     -   US Government (GCC High)
     -   China Cloud operated by 21Vianet
     -   US Department of Defense (DoD)
Power Apps Premium All Power Apps regions except the following:
     -   US Government (GCC)
     -   US Government (GCC High)
     -   China Cloud operated by 21Vianet
     -   US Department of Defense (DoD)
Contact
Name Microsoft
URL Microsoft LogicApps Support
Microsoft Power Automate Support
Microsoft Power Apps Support
Connector Metadata
Publisher Microsoft
Website https://azure.microsoft.com/solutions/data-lake/

To use this integration, you will need an Azure Data Lake Storage Gen1 account. You can create account in 3 ways: use Azure PowerShell; use Azure CLI; use Azure portal. For more information, see Get started.

Azure Data Lake Storage Gen2

The Azure Data Lake connector supports only Azure Data Lake Gen1. However, the Azure Blob Storage connector supports connecting to Azure Data Lake Storage Gen2 (ADLS Gen2) accounts, using multi-protocol access. You can read more about this new feature, including the availability and known limitations, in this blog.

Known Issues and Limitations

  • The connector support Azure Data Lake Gen1.
  • The Azure Data Lake limitations are documented here.
  • An error "Another chunk upload session is still active" may occur if throttling limits was exceeded during file upload. To avoid this, consider adding a delay between uploading multiple large files to the storage.

Creating a connection

The connector supports the following authentication types:
Default Parameters for creating connection. All regions Not shareable

Default

Applicable: All regions

Parameters for creating connection.

This is not shareable connection. If the power app is shared with another user, another user will be prompted to create new connection explicitly.

Throttling Limits

Name Calls Renewal Period
API calls per connection 3600 60 seconds

Actions

Append File (concurrent)

Concurrent append to a file.
Append File (sequential)

Append to a file serially.
Create Folder

Create a folder in a Data Lake Store account.
Delete File

Delete a file from a Data Lake Store account.
List Files

List files and folders in a Data Lake Store account.
Read File

Read data from a Data Lake Store account.
Upload File

Upload data into a Data Lake Store account.

Append File (concurrent)

Operation ID:
AppendFile_Concurrent

Concurrent append to a file.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
Append mode
 appendMode string

Set to auto-create if path doesn't exist.
File path
 filepath True string

Path of the file (no leading '/').
Content
 body True binary

Content of the file

Returns

Operation message
string

Append File (sequential)

Operation ID:
AppendFile_Sequential

Append to a file serially.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
File path
 filepath True string

Path of the file (no leading '/').
Content
 body True binary

Content to append
Offset
 offset integer

The optional offset in the stream to begin the append operation. Leave it empty or set value to file size in bytes. In both cases, the operation appends at the end of the stream.

Create Folder

Operation ID:
CreateFolder

Create a folder in a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
Folder path
 path True string

Path of the folder to create (no leading '/').

Returns

Body
operationPerformed

Delete File

Operation ID:
DeleteFile

Delete a file from a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
File path
 filepath True string

Path of the file (no leading '/').

Returns

Body
operationPerformed

List Files

Operation ID:
ListFiles

List files and folders in a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
Folder path
 path string

Path of the folder (no leading '/').

Returns

Body
folderResponse

Read File

Operation ID:
ReadFile

Read data from a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
File path
 filepath True string

Path of the file (no leading '/').

Returns

File content
binary

Upload File

Operation ID:
UploadFile

Upload data into a Data Lake Store account.

Parameters

Name Key Required Type Description
Account name
 account True string

Account name for Azure Data Lake.
File path
 filepath True string

Path of the file (no leading '/').
Overwrite
 overwrite boolean

Overwrite if existing file.
Content
 body True binary

Content of the file

Definitions

folderResponse

Name Path Type Description
FileStatus
 FileStatuses.FileStatus fileStatusArray

FileStatus

fileStatusArray

FileStatus

Name Path Type Description
File name
 pathSuffix string

File or folder name.
Type
 type string

Type of item (directory or file).
Block Size
 blockSize integer

Block size of folder or file.
Access Time
 accessTime integer

Unix (Epoch) time when the item last accessed.
Modification Time
 modificationTime integer

Unix (Epoch) time when the item last modified.

operationPerformed

Name Path Type Description
Is Successful
 boolean boolean

Flag if the last operation was successful.

string

This is the basic data type 'string'.

binary

This is the basic data type 'binary'.