question

VishBhanage-8330 avatar image
0 Votes"
VishBhanage-8330 asked VishBhanage-8330 commented

Query data in .csv file in Azure Data lake and insert queried data in Azure SQL using Azure Data lake

Data is in .csv file in Azure Data lake containers. We want to query the data in these files and insert the queried data directly in Azure SQL using Azure Data factory. Don't want to copy all the data from .csv as is to Azure SQL some temporary table and then query this table to fetch and insert data in another Azure SQL table.

Do I have to create Azure Data lake Analytics account and user U-SQL here? Will it server the purpose?

Thanks

Vishal

azure-data-factoryazure-data-lake-storageazure-data-lake-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered VishBhanage-8330 commented

Hello @VishBhanage-8330 ,
Thanks for the ask and using Microsoft Q&A platform .

Yes you will have a create ADL account . Let me point to thie blog by Mark , this should be helpful .
https://kromerbigdata.com/2019/03/03/u-sql-searchlog-aggregations-as-adf-data-flows/


Please do let me know how it goes .
Thanks
Himanshu


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks for confirming. Does U-SQL support Joins similar to SQL joins between two csv files which some relational table like mapping between each other? If not then what's the alternate method of doing it with U-SQL?

0 Votes 0 ·