I am using Azure Data Factory...I have two Cosmos dbs. One is our staging container and the other is our production container.
I want to create a pipeline that will look at our staging documents and compare them to our production documents.
1) If document (matid) is in staging and not in production, then we add the document to production (updating our LastUpdate date field to current UTC())
2) If document (matid) is in staging and IS in production, then we want to update that document in production and set the LastUpdate date field to current UTC().
So far I am trying this and the UPSERT seems to touch all documents. The issue is that since we are using json documents, the structure of the documents may change so I can't setup the mapping as defined, it has to be able to handle this.
