Extend Breakout Room time after opening rooms

Sometimes when we are using breakout rooms we want to extend the time, but once the room is opened, I lose access to the Settings, it is grayed out. 

How can I extend breakout room time if they are already in the rooms?