Hi @MattG! PM from the Office Scripts team here This currently isn't possible though we definitely hear you that it can be frustrating to see the script pane pop up every time a user clicks a button. Out of curiosity, what would you envision the ideal experience to look like?
Thanks for asking and for this feedback!
Cheers, Nancy on behalf of the Office Scripts team