Deselect File(s) when Scrolling Files using Touch Screen (modern view)?

How does one quickly deselect files, that have been selected when scrolling through a file list using touch screen?

Scrolling through a file list on SharePoint Online Modern View using touch screen is constantly selecting one or more files.  One touches the X (upper right 20 Selected X), which then scrolls the view to another spot in the list.  This makes it quite frustrating to work with on a touch screen.