Nov 12 2021 11:06 AM
when i try and use the bing site scan on my site in2town.co.uk it only reaches one page and comes up with the following error HTTP 400-499 errors
can anyone let me know how to solve this so i can scan my site
Jul 12 2023 09:10 AM - edited Jul 12 2023 09:39 AM
@sunshineman1970 I have solved it by creating a WAF custom rule that skips the user agent
"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
and the IP address that was getting blocked
you can also create WAF exceptions by Cloudflare's guide
https://developers.cloudflare.com/waf/troubleshooting/blocked-bing-site-scans/
