Is there a way to audit all the attachments incoming and outgoing for our tenant through O365? Say I want to see all of the emails that included HTML files.
Not really, best thing you can do is crawl the message trace (detailed) logs to get this info. If you are only interested in particular type(s) of attachments, creating a mail flow rule with the corresponding condition might be an option, assuming one of the available actions fits your needs.