Alternate way of closing all File Explorer windows

I'm using Explorer Patcher and it's working fine, except when I see the file explorer tab on my taskbar and I right click it and choose "close all windows" nothing happens. Is there an alternate way of closing the file explorer windows? Sometimes I have about 10 of them open. I tried Task manager and it doesn't have an "end task" for file explorer