Thumbnails in Explorer.exe Using Up Significant Memory

It seems that there is an issue with explorer with storing thumbnail cache for folders containing 6k to 8k resolution videos.

For context, I keep virtual reality videos in one folder and every single time I open this folder and browse through all other files and sub folders, the memory usage for explorer spikes up.

I need help on how to fix this issue. Any workarounds such as storing thumbnail cache on the drive instead of the RAM would help.