Broke inheritance for a folder that contains subfolders

I'm trying to find out the best aproach for scenarion below.

I have a main folder (FolderA) that contains many subfolders (subfolder1-100). Now, I want to have all user access to all subfolders except one (subfolder5, for example). Now, I've was going to "stop inheritance" option via Advanced Settings in Access Management, but the option is there. I guess it is because the subfolder5 has also some subfolders in it? Because when I tested it on a folder with no additional subfolders in it, I could see that option.

Wondering now, what is the best way to achieve the above?

Thanks,
Mike