Azure Database Migration service
An Azure service designed to help simplify, guide, and automate database migrations to Azure.
280 questions
1 answer
One of the answers was accepted by the question author.
how to replicate ongoing changes of on prem database to data lake?
Like AWS DMS handles ongoing replication and update bucket with respective files, what is available in azure to manage ongoing changes occurring at on-prem sql database? Initially it requires to do a full load in my data lake storage which can be…
asked 2020-06-19T17:52:50.293+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 42%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Seuli Das Majumder
101
Reputation points
accepted 2020-06-25T13:31:24.097+00:00
Seuli Das Majumder
101
Reputation points
2 answers
Extract the date hierarchy from previous data in Data Lake Partition
Hi Team, Would be of great help to get some clear assistance on the below query. Data source is Dynamic365 & SAP Hana. My requirement is to create a data lake partition(ADLS Gen2) with date…
asked 2020-06-07T07:02:45.193+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 96%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
RahulK
101
Reputation points
commented 2020-06-25T07:39:37.837+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 76%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECM%3C/text%3E%3C/svg%3E)
ChiragMishra-MSFT
951
Reputation points
1 answer
One of the answers was accepted by the question author.
Can a new user assign to Posix style ACL's without RBAC in Data Lake storge gen2
Hi all, i have a active directory user say A i want to assign him Posix style ACL's- folder permission without RABC permission. it is possible or not please confirm
asked 2020-06-15T10:09:26.967+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 20%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMV%3C/text%3E%3C/svg%3E)
manish verma
421
Reputation points
accepted 2020-06-24T09:45:18.06+00:00
manish verma
421
Reputation points
1 answer
how can we create a custom role in Data Lake Store Gen 2 has access on azure storage user can view folder and container but not read file data
HI All, in Data Lake Gen2. we have one requirement- we need to create a custom role-adding user in this role User- should be able to view folder , but not able to read data. how can we create a custom role to get this requirement
asked 2020-06-09T12:07:28.467+00:00
manish verma
421
Reputation points
commented 2020-06-18T11:48:42.797+00:00
PRADEEPCHEEKATLA-MSFT
78,246
Reputation points Microsoft Employee
1 answer
Access Control Exception on setting data lake storage gen1 as output
Hi, I am receiving JSON data as input of stream analytics job from IOT hub and trying to write it in Data Lake Storage Gen-1. The stream analytics job has read, write and execute permissions and I have read permission to Data Lake storage. According to…
asked 2020-04-19T12:33:39.407+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 48%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETS%3C/text%3E%3C/svg%3E)
Tanishq Singh
21
Reputation points
commented 2020-06-18T11:46:28.45+00:00
PRADEEPCHEEKATLA-MSFT
78,246
Reputation points Microsoft Employee
1 answer
More convenient service to read avro files from Azure Data Lake Gen2
Hi, I have to read lots of avro files created by an Event Hub Capture in a Data Lake Gen2. Data must be filtered, processed and then applied to train a machine learning model. I'm considering Azure Databricks and the Azure Machine Learning service…
asked 2020-06-08T22:37:56.897+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 92%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
Ariel Cedola
21
Reputation points
commented 2020-06-15T20:20:36.227+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
Creating datasets in Azure Machine Learning service from more than 100 paths
Hi, I need to create a dataset in Azure Machine Learning service from an Azure Data Lake Gen2 registered as a Datastore. Data in the lake are 1000's of avro files stored by an Event Hub Capture following the pattern…
asked 2020-06-09T16:08:40.387+00:00
Ariel Cedola
21
Reputation points
commented 2020-06-11T17:32:16.453+00:00
Ariel Cedola
21
Reputation points
1 answer
One of the answers was accepted by the question author.
HDInsight Cluster create a file with write mask
Hi, We are using Data Lake Gen 1 as the data store for HDInsight Cluster version 3.6. I wrote a simple spark code to write a file using saveas command of pyspark. The file is created in the DataLake with a write mask on. As a result. Any other user is…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 61%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
1 answer
How to push data from Azure Data lake to remote file server (network file folder)
Hello Experts, I need your guidance on how to push files from Azure Data lake to remote file server(network file folder). Our requirement is to send files from Azure Data Lake Gen2 to Remote File Server( Network File Folder), once the data pushed…
asked 2020-06-01T08:56:36.84+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 78%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
fbmsdn511
1
Reputation point
commented 2020-06-03T01:24:27.297+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,422
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Merge two different Azure Data Lake Storage Account under one subscription.
Hi There, I have two Storage accounts the old ADLS Gen1 under one Management Group and subscription and another new ADLS Gen 2 under entirely different Management Group and another subscription. Now, the requirement is to have complete data (Gen1 +…
asked 2020-05-30T19:05:57.457+00:00
Utkarsh Sharma
41
Reputation points
accepted 2020-05-30T20:14:21.87+00:00
Utkarsh Sharma
41
Reputation points
2 answers
One of the answers was accepted by the question author.
Copy Multiple files into ADL Gen2
I have a Data Factory pipeline that currently copies files daily from a Google Storage account down to an Azure Storage Blob ADL Gen2 enabled. Source several different files, File1, File2, File3 etc, all have a data range in the file name…
asked 2020-05-11T06:31:21.043+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
answered 2020-05-30T18:44:02.26+00:00
Utkarsh Sharma
41
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure File storage SAS TOKEN
I can upload files to ADLS Gen 2 blob storage with AzCopy through OAuth authorization, but I am unable to upload to file storage with the same. It is asking for SAS token. Please tell me the process of generating SAS token. Thanks. [Note: As we…
asked 2020-05-11T06:25:14.897+00:00
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
accepted 2020-05-11T10:24:28.987+00:00
Ramya Harinarthini_MSFT
5,306
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
SSIS connection manager for ADLS Gen 2
Could we use SSIS with ADLS gen2. I am trying to write file to Azure data lake gen 2 using Azure Blob Upload task and Azure Data Lake Store File System Task, but i am unable to do it. Thanks. [Note: As we migrate from MSDN, this question has been…
asked 2020-05-08T22:49:51.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 55.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
601
Reputation points
accepted 2020-05-08T23:04:57.96+00:00
HimanshuSinha-msft
601
Reputation points
1 answer
One of the answers was accepted by the question author.
Data Lake and Environments - Best Practice
Hello All, Is it a best practice to have one Big Data Lake for all the environments (Dev, Stage, QA and Prod) or have a Data Lake for Prod and another for Non-Prod ... etc.? If we chose to share a data lake across environments, then audit will play…
asked 2020-05-08T22:44:08.943+00:00
HimanshuSinha-msft
601
Reputation points
accepted 2020-05-08T23:04:48.817+00:00
HimanshuSinha-msft
601
Reputation points