we are doing a POC to use ADF dataflow mappings to load data in Snowflake WH tables. We tried to create a generic dataflow to read from the snowflake table and write to another snowflake table using schema drift option enable.
source table: 10 columns - 5 column names matches with target
Target Table: 5 columns
But the dataflow is failing at the source column which is not present in target table with error as
"Message":"Job failed due to reason: at Sink 'SinkHub': java.sql.BatchUpdateException: SQL compilation error: error line 1 at position 3\ninvalid identifier 'XYZ'"
Dataflow is successful only if we keep exact column names in source table like target table. We are expecting that columns matched should get populated when Auto Mapping is enabled.
That means dataflow schema drift option is not working with snowflake database.
anyone faced similar issue?.