How do I disable this feature? Always shows the last played media

Open Windows Media Player. Click on the Organize menu option on the toolbar. Select Options. In the Privacy tab, you can uncheck Keep player in the taskbar or any options related to recent media lists.