Outlook for macOS not finding all contacts

I'm using Office 365 for macOS and I use Outlook (v16.77.1) connected to my Google account.  When I create a new Email, it can find some of my contacts when I search for them but not all, and those it cannot find, I can go to the Contacts view and see them there.  So my Google Contacts data is syncing correctly; it's just that Outlook apparently can't find all of it when trying to address a new Email.

Interestingly, I can just type the Email address in the To: field and send the message, then when I open the sent message, I can click on the address and it pulls up that person's info from Outlook contacts.

Any thoughts on how to fix this?