How to navigate between different libraries

I have a site with a number of different libraries - the site is replacing our old folder structure with many folders and sub folders. Users are used to navigate in folders and are reluctant to move away from the old folder structure.

I have some problems with creating easy navigation between libraries in SharePoint. On our main site, my plan is to add an overview of all our libraries (to mimic the folder view), but how do I do that? And how do users navigate across different libraries with out having to go to site contents everytime.