Missing sites under Destinations when I try to move or copy files in modern library

When I try to move a file or folder, the destination dialogue box lists only a subset of sites I have access to under two headings: Following and Recent. How can I choose a site that is in neither of...