Hello friends when file compression for parquet happens before writing the data or after data write help me please
Hello friends when file compression for parquet happens before writing the data or after data write help me please
Hello @Anshal-7634,
Thanks for the question and using MS Q&A platform.
My understanding from below article is that the parquet data is compressed in memory before the file is being written.
For more detailed explanation, please refer to this article by community volunteer - How Parquet Files are Written – Row Groups, Pages, Required Memory and Flush Operations
Hope this info helps.
Hello @Anshal-7634,
Just checking in to see if the above response was helpful. And, if you have any further query do let us know.
10 people are following this question.