Please fix the issue with the app constantly popping up in the task bar when "Hide when minimized"

So, "Hide when minimized" is on. Initially, there's only icon in the tray, nothing in the task bar. But when new email comes in, or some reminder pops up, the app shows up in the task bar (besides reminder). I click on it, so it opens up and then minimize to make it disappear. It's annoying.