question

BV-0330 avatar image
0 Votes"
BV-0330 asked PRADEEPCHEEKATLA-MSFT edited

Azure Data Factory - Lookup activity for ADLS G2/Blob - Can we have file name included in the output of the lookup activity?

Currently Lookup activity for ADLS G2/Blob returns only the data. Please can we have file name(s) included in the output of the lookup activity?
i.e. if the lookup activity is looking at a root folder and returns rows from multiple files or a single file, it would be great to include the file name (+ relative path) as a column in the results

Currently we can use Get Metadata activity and For Each Loop with Lookup to achieve this. But is really cumbersome.

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered PRADEEPCHEEKATLA-MSFT edited

Hello @BV-0330 ,
Thanks for the ask and using Microsoft Q&A platform and sharing your feedback .
You also pass on the feedback on rge ADF UI also , please see the snapshot below . We will be passing this feedback to the ADF team .

134330-image.png

Just on a side note , if you are reading the data from a single file , you can parameterized the dataset and pass the file name as a parameter , this will atleast unblock you for now as you can reference the parameter in the pipeline later . Off course this will not work for scenarios where we use wildcard .

Please do let me know how it goes .
Thanks
Himanshu


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


image.png (26.3 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.