Forum Discussion

shaebert's avatar
shaebert
Copper Contributor
Mar 20, 2024
Solved

Need Help with SQL Server Express, Folder of CSVs and Power BI

Hello, I have a folder of CSVs that is updated daily. I want to get those into an SQL server and connect to Power BI. 

 

The reason I am going this route is Power BI currently just imports the CSVs and combines them, but it is killing the performance while working in Power BI Power Query. 

 

What is the best way to load and combine the files into SQL Server Express so I can connect the database to Power BI? 

  • Hi shaebert 

     

    I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table

     

    https://docs.dbatools.io/Import-DbaCsv.html

     

    It is a PowerShell tool and definitively super easy to use.

     

    Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler

     

    Regards

    Javier

  • Hi shaebert 

     

    I have a similar situation and I am using DBATools , specifically the module Import-DbaCsv which allow you to imports multiple files in one shot into a SQL Table

     

    https://docs.dbatools.io/Import-DbaCsv.html

     

    It is a PowerShell tool and definitively super easy to use.

     

    Since you use SQL Express Edition you don't have a SQL Server Agent to schedule the task but you can use Windows Task Scheduler

     

    Regards

    Javier

Resources