Am I able to get rid of receiving insider builds if I put in a new windows key

Changing your Windows product key does not directly remove you from the Insider Program. You must manually select "Stop getting preview builds" by going to Settings > Update & Security > Windows Insider Program.