Notifications appear to come through when someone mentions you here on the Office 365 Network, which is good. However a new notification e-mail is sent, telling you that you've been mentioned, every time that post is edited.
The subsequent notifications should be suppressed if the post is edited, unless perhaps the edit relates to the mention itself.