Can't Delete file

I am trying to delete an Excel Spreadsheet from my desktop, but when I do it say's "this action cannot be completed because the file is open in NortonSecurity.exe".   When I go to the norton the task manager to end task, it say's my access is denied.  Any suggestions on how to fix this?