have a requirement to do the Data integration from various source systems to a Master Data Management (MDM). Requirement in crux:
Target system is a MDM (Master data management) which needs data in a XML format.
Multiple Source systems to give different type of attributes (call data columns)
Format of source data is varied like CSV, through API, SAP to Azure Data Lake etc..
Some source systems wants to send through API, some through sFTP etc..
My suggested solution is >>> keep all the source files (is source format) in ADL >> Get Data transformation done( in ADF / Synapes / ADL.. I dont know) >> Azure Function to convert transformed code into XML >> Send to Target
I know there are so many gaps in this solution. I dont know about data handling capacity for Logic apps / Functions. Can we use Logic app connectors to get the bulk data and place in Data storage...
Please share your approach best suited solution for such problem statement.