Mapping SharePoint list items using Azure Maps

I have a SharePoint list with office locations. Our client would like to show all of these locations on a map. Getting a Bing Maps key is no longer an option - this has been deprecated, so we will need to use Azure maps instead. We have a Azure Maps key, but are unsure of how to enable it in SharePoint. Every blog post we find only has instructions for Bing Maps. Any help is much appreciated!