I'm currently evaluating the Baseline for our 2019 servers. One thing that just created massive performance issues was VBS. With it enabled, the most basic things started to slow to a crawl, such as opening the Windows Explorer or IE11. After manually disabling VBS we gained a 40% performance boost.
My suggestion is to make VBS entirely optional. Opposed to all other settings in the baseline, VBS does rely heavily on hardware support and comes with a performance hit. The way the baseline is designed, it's currently quite complicated to opt-out of VBS.