Forum Discussion

Dezmond95's avatar
Dezmond95
Copper Contributor
Mar 09, 2023

Web Query not refreshing updated data from website

I have been attempting to pull flight schedules from a website using Excel's web query. 

The initial time I requested information, I got the information back exactly how I wanted it but it appears to be stuck on that view and when I refresh it, nothing changes even though the websites content has since changed.

 

I have attached some images highlighting the issue, the excel sheet shows outdated information by about an hour. 

 

I have been working on this across several computers and it seems the first time the web query is performed on a new computer it will update correctly but then get stuck on that info and wont refresh.

I've since learned about BF caching where the saves a snapshot of the website so that if the client returns the content is already ready, i think this may have something to do with the problem but all the tutorials ive seen online seem to show exactly what i did but their attempts at refreshing live data works.

 

I came across a post where they recommended Fiddler and I tried that, i recorded the http requests when I recorded myself trying to refresh the query and no direct link occurred with the URL i specified. there was a lot of tunnel to random things, just not the flight schedule website that I specified into the query.

 

I'd really appreciate any insight into how I may resolve this

 

Edit: URL is https://www.wellingtonairport.co.nz/flights/?direction=departure

In my last attempt, I added '&today=refresh' to the URL source, this appeared to work and it did initially refresh changes that were occuring. I then saved it, uploaded the workbook to onedrive. I have since reopened the workbook both through one drive and locally and it had reverted to being static.

 

10 Replies

      • Riny_van_Eekelen's avatar
        Riny_van_Eekelen
        Platinum Contributor

        Dezmond95 Two arriving flights just had a status change and one disappeared from the table.

        NZ457 initially had "Landed 21:18". A few minutes later it updated to "Arrived at Gate".

        NZ459 was still in the air when I created the macro, thus no status. It landed 21:34 though the website took 12 minutes to show it. The query still doesn't pick up this one but it does reflect others.

        The "First connection" info reflects the Arrival status from some approx. 30 minutes before the PQ status. So, there are updates, but it seems to be with quite some delay.

         

         

         

Resources