This is ADLS Gen 1 to ADLS Gen 1 copy.
The source folder structure is main/device/supplies/year=2021/month=202109/day=20210903/abcd.parquet
There are multiple parquet files in different year, month and day folders partitioned by year, month and day
I need to copy all the parquet files to Sink and have them in similarly partitioned folders.
In the Source Parquet dataset, I've put the top level container only i.e. main in the directory box and kept the file part empty
I've kept the Data Flow "Source Options" as below:

But Data Preview is not able to detect the files

Could you please help
My usecase is similar to what is explained here https://www.youtube.com/watch?v=7Q-db4Qgc4M
