Reorder columns in response spreadsheet after reordering in form

I'm sure this is a bug but if you change the order of columns after creating a form, the change isn't reflected in the underlying spreadsheet. How is this done?