Hi All
I am using Azure App Proxy to publish some internet facing websites back to on prem. I have come across the issue where Azure, by default blocks bots such as Google from indexing your websites (https://docs.microsoft.com/en-us/azure/active-directory/manage-apps/application-proxy-security#remot...) How can I get around this, as I need Google bots etc to index the published sites.
When looking online I found this https://docs.microsoft.com/en-us/azure/web-application-firewall/afds/afds-overview#waf-policy-and-ru... about the WAF but will I be able to control certain App Proxy rules with this and allow the bots ? I have checked and currently we have no WAF rules setup, so I assume we need to create one to allow the bot, but would this work ?
Thanks
