LukeEds , I am having a similar cost issue. I have 3 sites in a multi-site Azure Linux Wordpress and it's $45/month (mostly MySQL traffic costs) with very little traffic. The cost estimates provided while setting this up are really inaccurate, or there's some simple fix... but even with CDN, caching, extending the TTL on all pages and caches etc. the database server is being queried way too much (no Comments are enabled, the sites are static).
I am on a Basic B1 plan for the Web App, and for my dbserver I've set it to Burstable (1-20 vCores). I think moving to a B2 would increase the costs. And there's no way I see to reduce the MySQL queries... I was hoping caching would reduce the querying because the sites are static. But apparently not.
My old Windows-based Azure Wordpress site was about $12/month for the same sites. Sure, it was slow, but these sites have near zero traffic.
I'm guessing I just need to flatten them to HTML static sites and host them some other way.