question

arkiboys avatar image
0 Votes"
arkiboys asked NandanHegde-7720 commented

config file to read from before processing

Hello,
At present my configuration is being read from on-prem sql server table...
Which file format is best to have instead of the on-prem sql table?
For example, I can have .csv or excel, json, etc and read through the rows of the file but would like to kow which one is best to use and place in cloud blobstorage?
Thank you

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 answered NandanHegde-7720 commented

Hey,
Every file type has its own advantages and disadvantages.
The file type selection should depend on how comfortable the team is parsing those files in case of any changes or modifications etc .
And also since you are planning to move from table to file for Config details, be sure that there are some limitations in lookup activity w.r.t the amount of records that can be retrived.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Will the lookup activity handle up to 10,000 rows to read from csv?
Is there a set limit to lookup rows?
Thank you

0 Votes 0 ·

131758-image.png

Limitations

0 Votes 0 ·
image.png (40.0 KiB)