Forum Discussion
mrgamadden
Aug 19, 2024Copper Contributor
Combine two files remove duplicate row when two columns have same value
I have a report that runs daily from our ERP that contains shipping history for current month. I need to combine the report that was run today with the report that was run yesterday. My issue is this...
SergeiBaklan
Aug 19, 2024MVP
As variant you may keep all daily reports in some folder / SharePoint folder; use Power Query with From (SharePoint) Folder connector to combine them, apply Remove Duplicates to the result.
If result is only for Power BI dashboard, perhaps you don't need to build resulting Excel file. Dataflow is more practical variant. You may refresh it on schedule or/and by Power Automate.
mrgamadden
Aug 20, 2024Copper Contributor
SergeiBaklan i am not aware of how to use the that you are suggesting in SharePoint or in PBI that would allow me to remove duplicates from two columns. I’m only aware of it being able to remove duplicates from one column. Please on how to remove duplicates as i Originally asked in my post
- SergeiBaklanAug 20, 2024MVP
Power Query for it
let Source = Excel.CurrentWorkbook(){[Name="Source"]}[Content], #"Removed Duplicates" = Table.Distinct(Source) in #"Removed Duplicates"
which gives