d16_v3 compute instance takes forever just for a simple preprocessing of a 4 GB chunk size of tabular data from the azure blob storage. This action is executed by a pipeline here and it is stuck on the preparing stage for a long time. ~2 weeks the pipeline was through within an hour.
what could possibly go wrong here?