Reset Dial-in conferencing PIN seems to be available for Skype Online users now

Works in my tenant now. Users still can't choose their own PINs, but atleast they can now reset it themselves :-)

Clicking the "Forgot your dial-in PIN?" in the meeting invite will redirect you to this online page.