Little brown boxes in my icons (and Dropbox) despite clicking "Always keep on device" in OneNote

I'm seeing little brown boxes in the corners of many of my icons, even with files inside my DropBox folder. I know this is caused by OneNote. I clicked on my OneNote folder and selected "Always Keep ...