Forum Discussion
TorienDeJager
Nov 22, 2023Copper Contributor
Merging and appending multiple files using the Data Tab
Use Case: I receive 7 data files (csv and Excel), from various suppliers, in various formats. I clean the data through Power Query into the same column headers. I now need to combine these files/tabl...
Lorenzo
Nov 22, 2023Silver Contributor
I am sure that this must be simple
When you Searched the Net
for same/similar scenario you probably understood that's not that simple
. Depending on the actual scenario & data sources approach might be slightly different
Quick (first) questions:
- Can duplicate SKUs exist within the same Table?
- When duplicated SKUs exist in 2, 3, ... 7 Tables, do they share/have the same [PRODUCT_ID] (you show [PRODUCT_ID] in your desired output but not in your sample Table)
- Could you upload & share (i.e. https://support.microsoft.com/en-us/office/share-onedrive-files-and-folders-9fcc2f7d-de0c-4cec-93b0-a82024800c07, Google Drive,... or the like) a workbook with says 3 (out of your 7) Tables so we don't spend time creating dummy - and probably not representative - data please?
TorienDeJager
Nov 22, 2023Copper Contributor
1. Duplicate SKU's can't exist in the same table.
2. The product ID is Unique for every line item, and is typically allocated within the ecommerce platform on upload.
3. Unfortunately I can't break the file down, as it has taken on a life of it's own over the month, with many hundreds of dependencies.
2. The product ID is Unique for every line item, and is typically allocated within the ecommerce platform on upload.
3. Unfortunately I can't break the file down, as it has taken on a life of it's own over the month, with many hundreds of dependencies.
- LorenzoNov 23, 2023Silver Contributor
- Duplicate SKU's can't exist in the same table
OK - The product ID is Unique for every line item
That doesn't help me understand I'm afraid. Does 'line item' mean SKU? - Unfortunately I can't break the file down
??? In an effort to help you I created 3 tables (attached) with dummy data (took +/- 15 mins, no more...). Are they representative of your scenario/context? If not please reshape, fill them & share the file so we have something realistic to work with. Thanks
- TorienDeJagerNov 23, 2023Copper ContributorThat is the kindest thing anyone has done for me all week, thank you, thank you, thank you.
You have it exactly.
Is there a way to filter it by SKU and Lowest cost per SKU, so that I only publish a single SKU in the SKU Column?- Yea_SoApr 13, 2024Bronze Contributor
Merged table1-3 and added it to data model
created power pivot table
Set the value to Min of Price
See attached
- Duplicate SKU's can't exist in the same table