Forum Discussion
shaebert
Mar 20, 2024Copper Contributor
Need Help with SQL Server Express, Folder of CSVs and Power BI
Hello, I have a folder of CSVs that is updated daily. I want to get those into an SQL server and connect to Power BI.
The reason I am going this route is Power BI currently just imports the CSVs and combines them, but it is killing the performance while working in Power BI Power Query.
What is the best way to load and combine the files into SQL Server Express so I can connect the database to Power BI?
Hi shaebert
I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table
https://docs.dbatools.io/Import-DbaCsv.html
It is a PowerShell tool and definitively super easy to use.
Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler
Regards
Javier
Hi shaebert
I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table
https://docs.dbatools.io/Import-DbaCsv.html
It is a PowerShell tool and definitively super easy to use.
Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler
Regards
Javier
- shaebertCopper Contributor
Javier_Villegas Awesome thank you!