I am testing a data pipeline using ADF (The databricks version works fine).
The idea is to automate the parsing of multiples text files (fixed length) and different schemas.
Using the attached image as example I have substring expressions for each field and the record inline(column C0). How can I replace the column values with the result of each code (substring)?
That image is an output of a pivot transformation. The substring expressions were dynamically created