Sharepoint not loading all contacts from outlook

Hi

I have a sharepoint contact list that is linked to Outlook .  However Sharepoint is not loading all the contacts that I have put into the Sharepoint link in outlook. As shown below on the right picture the Outlook Sharepoint link shows 655 records.  However, when loaded into Sharepoint on the left it shows only 96. Is there something in the settings that need changing?  How do I bring all the records in the Sharepoint outlook connection into Sharepoint?

Help appreciated