Outlook add in not loading first time on IE 11 and IE edge

Currently working on a Office Add in for Outlook. The add in works correctly on Outlook Desktop and Outlook Web on Chrome. On IE 11 and IE Edge, the add in does not load the first time unless you click on "retry" after receiving the the following error. I can replicate this issue by clearing the cache and reloading the add in again.  Any suggestions on how to get the Add in to load on first load.