Combine files (binaries) in Power BI Desktop
One powerful approach to importing data into Power BI Desktop is to combine multiple files, which have the same schema, into a single logical table. With the November 2016 release of Power BI Desktop (and subsequent releases), this convenient and popular approach has been made more convenient and more expansive, as described in this article.
To start the process of combining files from the same folder, select Get Data > File > Folder.
Previous combine files (binaries) behavior
Prior to the November 2016 release of Power BI Desktop, this functionality was called Combine Binaries, and you could combine certain file types with the combine binaries transform, but there were limitations:
- Transformations were not considered for each individual file before the files were combined into a single table. As such, you often had to combine files, then filter out header values by filtering rows as part of the edit process.
- The Combine binaries transform only worked for text or CSV files, and didn't work on other supported file formats such as Excel workbooks, JSON files, and others.
Customers asked for more intuitive operation of the combine binaries operation, so the transform was enhanced and renamed combine files.
Current combine files behavior
Power BI Desktop now handles the combine files (binaries) more effectively. You start by selecting combine files, either from the Home ribbon tab in Query Editor, or from the column itself.
The combine files transform now behaves as follows:
The combine files transform analyzes each input file, and determines the correct file format to use, such as text or Excel workbook or JSON file.
The transform allows you to select a specific object from the first file, for example, an Excel workbook, to extract.
The combine files then automatically performs the following queries:
Creates an example query that performs all the required extraction steps in a single file.
Creates a function query that parameterizes the file/binary input to the exemplar query. The exemplar query and the function query are linked, so that changes to the exemplar query are reflected in the function query.
Applies the function query to the original query with input binaries (for example, the Folder query) so it applies the function query for binary inputs on each row, then expands the resulting data extraction as top-level columns.
With the new behavior of combine files, you can easily combine all files within a given folder as long as they have the same file type and structure (such as the same columns).
In addition, you can easily apply additional transformation or extraction steps by modifying the automatically created exemplar query, without having to worry about modifying or creating additional function query steps. Any changes to the exemplar query are automatically generated in the linked function query.
There are all sorts of data you can connect to using Power BI Desktop. For more information on data sources, check out the following resources: