SOLVED

Need Help with SQL Server Express, Folder of CSVs and Power BI

Copper Contributor

Hello, I have a folder of CSVs that is updated daily. I want to get those into an SQL server and connect to Power BI. 

 

The reason I am going this route is Power BI currently just imports the CSVs and combines them, but it is killing the performance while working in Power BI Power Query. 

 

What is the best way to load and combine the files into SQL Server Express so I can connect the database to Power BI? 

2 Replies
best response confirmed by shaebert (Copper Contributor)
Solution

Hi @shaebert 

 

I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table

 

https://docs.dbatools.io/Import-DbaCsv.html

 

It is a PowerShell tool and definitively super easy to use.

 

Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler

 

Regards

Javier

1 best response

Accepted Solutions
best response confirmed by shaebert (Copper Contributor)
Solution

Hi @shaebert 

 

I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table

 

https://docs.dbatools.io/Import-DbaCsv.html

 

It is a PowerShell tool and definitively super easy to use.

 

Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler

 

Regards

Javier

View solution in original post