Reply to a redirected email to the original sender and using the same from address

I have two email addresses -

mailto:email address removed for privacy reasons

mailto:email address removed for privacy reasons

All messages that are received on mailto:email address removed for privacy reasons are redirected (not forwarded) to mailto:email address removed for privacy reasons. 

Now when I reply to the email the To field takes the original senders email address which is good to me, but the from address is the redirected email address which is mailto:email address removed for privacy reasons.

I am trying to have the from address the same as what email address the original email was sent to. Is there a way to do this in Outlook?