Getting the following error. Loading 215 M rows as CSV format from Data Lake Gen 2 to Data Lake Gen 2.
Using memory optimized cluster with 8 core and 10 round robin partition, CSV file size two files 16 GB and 11 GB.
Error message:
Error: Status Code DF execute user error: Job Failed due to reason, unable to acquire 732 bytes of memory got 0.