Personally, I think Conversations inside Channels is way more effective for serious work in a functional team. I prefer to keep Chat for more informal work.
My suggestion is to organise your Channels for each Team so that important conversations, with good subject/Topic headings happen in the appropriate Channel for that team. And because the conversations in a Channel collapse, it makes it way more effective than email and certainly Group Chats. (well, the conversation almost collapses, apart from the last three replies which I find frustrating).
And then combine this with the fact that you can link in the conversations to an important file, that sits in that Channel, within its SharePoint Folder.
So, I think it's better to keep a clear distinction between Chats and Channel conversations. My 2 cents worth anyway. I wrote this article few years ago and the groups I work with almost always seem to agree.
I'm keen to hear other people's thoughts though - https://www.lingfordconsulting.com.au/microsoft-office-365a/conversations-in-microsoft-teams-more-efficient-than-email