Deploy sharepoint framework parts to specific site collection

You're correct, so by not choosing the tenant-wide deployment option and installing the app in your site instead, you would make your web parts available only in that particular Site Collection. At this moment there is no option to deploy the .sppkg file to a specific site directly, without using the global App Catalog, so the approach described above is your only option.