SharePoint Edit Feature

I have created a SharePoint site but when visitors go to the site they are able to see the EDIT button.  I have changed the permissions to Read-only, but the EDIT button remains, which will allow anyone who visits the site to edit, which I do NOT want.  Does anyone know how to remove the EDIT button so that it doesn't show?  I have provided a few screenshots as well for reference.