Custom column layout breaks on mobile view — SharePoint Online Communication Site

I'm not sure I fully understand what you've created, but have you tried using the new(ish) Flexible Section instead of columns? You can still create the illusion of columns, but in the section settings you can direct it to read the page vertically or horizontally in mobile and email view.