Modern Sites Left Navigation not security Trimmed

I discovered yesterday that security trimming only applies if you Promote the page to the navigation rather than just pasting in the URL.

We had pages that had specific security applied but would show in the navigation because we manually added them as links, when we deleted the item and then went to the page and used the Promote option, it was then security trimmed.