I'm trying to transfer data over from AmazonS3 to my Azure Data Lake. I'm currently given access to the s3 bucket via an access point.
When I write python it looks like this:
AWSAccessKeyId='AKIAJQSDEGOZWTVPUETQ' AWSSecretKey='xxxxx' Bucket="arn:aws:s3:us-west-2:xxxxx:accesspoint/datafeed", Prefix="dplp-aea10a31/" client = boto3.client('s3', aws_access_key_id=AWSAccessKeyId, aws_secret_access_key=AWSSecretKey, region_name='us-east-1' ) dict_objects = client.list_objects_v2( Bucket="arn:aws:s3:us-west-2:xxxxx:accesspoint/datafeed", Prefix="dplp-aea10a31/" )
The problem I have now is I have to download the file and read it. I'm looking to transfer it to my data lake to make it easier to deal with.
I don't see any way to do this thru Azure Synapse / Data Lake at first look.