Mar 20 2024 10:10 AM
Hello, I have a folder of CSVs that is updated daily. I want to get those into an SQL server and connect to Power BI.
The reason I am going this route is Power BI currently just imports the CSVs and combines them, but it is killing the performance while working in Power BI Power Query.
What is the best way to load and combine the files into SQL Server Express so I can connect the database to Power BI?
Mar 21 2024 10:44 AM
SolutionHi @shaebert
I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table
https://docs.dbatools.io/Import-DbaCsv.html
It is a PowerShell tool and definitively super easy to use.
Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler
Regards
Javier
Mar 22 2024 03:02 PM
@Javier_Villegas Awesome thank you!
Mar 21 2024 10:44 AM
SolutionHi @shaebert
I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table
https://docs.dbatools.io/Import-DbaCsv.html
It is a PowerShell tool and definitively super easy to use.
Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler
Regards
Javier