Is removing "Record Name" really the same as making a Form anonymous?

I understand this means I can't see the name of the responder - but is there still a way an admin could get access to data that could be used to see who voted for what?

This is a question for situations that may require a survey that must not have a way to tie the answers back to an individual.