Forum Discussion

sunshineman1970's avatar
sunshineman1970
Copper Contributor
Nov 12, 2021

bing site scan not working

when i try and use the bing site scan on my site in2town.co.uk it only reaches one page and comes up with the following error HTTP 400-499 errors

 

can anyone let me know how to solve this so i can scan my site

14 Replies

Show More
  • conferfly's avatar
    conferfly
    Copper Contributor
    Jul 13, 2024

    We have the same issue with https://conferfly.com and the https://blog.conferfly.com.

  • idanins's avatar
    idanins
    Copper Contributor
    Jul 12, 2023

    sunshineman1970 I have solved it by creating a WAF custom rule that skips the user agent

    "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

    and the IP address that was getting blocked

     

    you can also create WAF exceptions by Cloudflare's guide

    https://developers.cloudflare.com/waf/troubleshooting/blocked-bing-site-scans/

    • farwa355's avatar
      farwa355
      Copper Contributor
      Jul 30, 2024

      idanins Same happened with my site https://dunebuggy-dubai.ae/

      I tried asking everyone, from quora too. Did You find any solution?

    • Abdul_Majid's avatar
      Abdul_Majid
      Copper Contributor
      Jul 13, 2024

      I have the same issue, Bing is not indexing all of my site pages, although my site speed is very good. 

       

      I have following instructions by Bing

      1. These pages have 400-499 http status code. Ensuring http status 200 might help improve SERP performance and gain user traffic.

       

      2.   Urls with these errors may be fixed by updating your site

       

      I did both steps and checked my site speed with  Gtmetrix and PageSpeed Insights, the results and better then many sites that are indexed on Bing.

       

      I am mentioning my site URL (If allowed) https://techsaa.com Please check it and help me. I need some easy instructions. 

       

      Thanks 

       
       

Resources