Microsoft Forms Does Not Close on Submit

We are using an embedded survey on our website. We rendering the survey as a popup. When a user submits a response, it no longer closes on its own. There is an "X" on the top right of the popup but the business wants it to be hidden so that users are forced to take it. Was there a change in behavior of the popup surveys? How can we get back the functionality of closing the popup on a submission?

Any and all help would be appreciated!