Hello friends when file compression for parquet happens before writing the data or after data write help me please
Thanks for the question and using MS Q&A platform.
My understanding from below article is that the parquet data is compressed in memory before the file is being written.
For more detailed explanation, please refer to this article by community volunteer - How Parquet Files are Written – Row Groups, Pages, Required Memory and Flush Operations
Hope this info helps.
10 people are following this question.