Hi All, I have gone through the same question processing billion records in databricks in to Data warehouse.
I tried to find out the approach to do similar task in Azure Data Factory but I couldn't able to find any solution for the same. I will be grateful if you could please explain how you would design a pipeline to process billion records and that should provide a near real time analytics. Thanks a lot.