Move To Sharepoint Online version history not in tact

I am facing an issue where the inbuilt move to functionality which is supposed to keep version history in tact is moving all of the metadata changes to the latest published version once moved. I have the end goal of moving files from one sharepoint document library to another in the same sharepoint site and retaining version history (important that it remains identical in the destination library). The versioning settings and advanced settings of the document libaries are identical. 

Example: I change the value of a column "VersionNr" from 1 to 2 in version 0.1 of the document. I then publish the document so its version is increased to 1.0. I then change the value of "VersionNr" again, to 3, which creates a draft version 1.1 of the document. If I move this file (or a published version of the file, it doesn't matter) to my newly created document library with identical settings and content types, all metadata changes end up in my latest version, i.e 1.1 or 2.0. Meaning my changes in version 0.1 of the document are moved from 0.1 to 1.1/2.0. 

Has anybody else had this problem and if so how do I remedy this?