Add Delete Button in Message View

There's no way to add it there, but it will still be available within the Ribbon on top, or when you hover over the message in the message list above (additional buttons will appear in the right-most column). You can also make the habit of hitting the Backspace key on your keyboard as a quick "delete" option.