Outbound IPs on App Services

I recently moved a number of my app services into a NAT gateway Vnet integration with a static outbound public IP.  I have confirmed that the traffic is using the new static public IP but when I look at the app in portal.azure.com I still see all the multi-tenant outbound public IPs listed as "outbound IPs" they used to use, and my public static IP that the NAT gateway uses is not listed at all. This adds confusion for our more junior members of the team.  Is there a way to remove seeing those the multi-tenant outbound IPs now that they are not used?