My client wants to load data from Salesforce both bulk and incremental. and wants to make the pipeline dynamic using lookup and foreach to fetch data from all the tables and all the columns from each table.
if the source is SQL or Oracle select * works, however with SOQL it doesn't work.
however, SOQL doesn’t support select , ADF supports it! And is expanded to all fields underneath.
Tried select * doing bulk load and it did work. but trying the same with incremental load using where clause isn't working. and giving following errors :
Exact Query listed below with error message :
Tried below queries that couldn't work with select
@concat('select from ',item().SOURCE_TBL_NAME,' where SYSTEMMODSTAMP = select convert(date,getdate()-1)')
@concat('select from ',item().SOURCE_TBL_NAME,' where SYSTEMMODSTAMP = YESTERDAY')
@concat('select from ',item().SOURCE_TBL_NAME,' where SYSTEMMODSTAMP = TRUNC(SYSDATE) -1')
@concat('select fields(ALL) from ',item().SOURCE_TBL_NAME,' where SYSTEMMODSTAMP = YESTERDAY')
ERROR Message : 
however, the following works fine when the columns are specified.
@concat('select ',item().COLUMN_LIST,' from ',item().SOURCE_TBL_NAME,' where SYSTEMMODSTAMP = YESTERDAY')
Any way to make it dynamic - or using select * with where clause via ADF for salesforce?