Ability to ignore a call from a Call Queue

Is it possible to ignore a call that comes in on a call queue?  We have a call queue setup and the only option when the notificiation comes us is to answer.  This makes it kind of annoying if you are...