AmazonS3Dataset Class

A single Amazon Simple Storage Service (S3) object or a set of S3 objects.

All required parameters must be populated in order to send to Azure.

Inheritance

azure.mgmt.datafactory.models._models_py3.Dataset

AmazonS3Dataset

Constructor

AmazonS3Dataset(*, linked_service_name: _models.LinkedServiceReference, bucket_name: Any, additional_properties: Optional[Dict[str, Any]] = None, description: Optional[str] = None, structure: Optional[Any] = None, schema: Optional[Any] = None, parameters: Optional[Dict[str, _models.ParameterSpecification]] = None, annotations: Optional[List[Any]] = None, folder: Optional[_models.DatasetFolder] = None, key: Optional[Any] = None, prefix: Optional[Any] = None, version: Optional[Any] = None, modified_datetime_start: Optional[Any] = None, modified_datetime_end: Optional[Any] = None, format: Optional[_models.DatasetStorageFormat] = None, compression: Optional[_models.DatasetCompression] = None, **kwargs)

Variables

additional_properties

dict[str, any]

Unmatched properties from the message are deserialized to this collection.

type

str

Required. Type of dataset.Constant filled by server.

description

str

Dataset description.

structure

any

Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.

schema

any

Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.

linked_service_name

LinkedServiceReference

Required. Linked service reference.

parameters

dict[str, ParameterSpecification]

Parameters for dataset.

annotations

list[any]

List of tags that can be used for describing the Dataset.

folder

DatasetFolder

The folder that this Dataset is in. If not specified, Dataset will appear at the root level.

bucket_name

any

Required. The name of the Amazon S3 bucket. Type: string (or Expression with resultType string).

key

any

The key of the Amazon S3 object. Type: string (or Expression with resultType string).

prefix

any

The prefix filter for the S3 object name. Type: string (or Expression with resultType string).

version

any

The version for the S3 object. Type: string (or Expression with resultType string).

modified_datetime_start

any

The start of S3 object's modified datetime. Type: string (or Expression with resultType string).

modified_datetime_end

any

The end of S3 object's modified datetime. Type: string (or Expression with resultType string).

format

DatasetStorageFormat

The format of files.

compression

DatasetCompression

The data compression method used for the Amazon S3 object.