Forum Discussion
How to Compare USB Flash Drive Folders for Duplicate Files
I have a USB flash drive filled with thousands of MP3 song files. Some are organized within an "Artist" folder, while others are scattered in a folder called "Random." I decided to revamp my music collection by creating a "Done" folder with organized artists and albums, such as Garth Brooks' albums with complete details like album art, genre, and release year.
I am looking for an easier way to identify and remove duplicate files based on artist names or group names. Currently, I manually search for each artist in the "Random" folder to eliminate duplicates. Is there a more efficient method, perhaps a free program compatible with Windows 11, that can help streamline this process? I want to avoid having multiple copies of the same songs with incorrect file names but correct tags.
If you have any suggestions or recommendations to simplify this task, please let me know. Thank you!
4 Replies
A simple and free program that allows you to scan folders for duplicate files based on various criteria, including file name, size, and content (i.e., MD5 hash). You can also filter duplicates by file type (e.g., MP3) and specify a threshold for file similarity.
I would use the command line in conjunction with PowerShell to compare them based on the MD5sum hash value, given it's faster and more efficient. Change both "E:\Folder_Name_Here\Subfolder_Name\" and "E:\\Folder_Name_Here\\Subfolder_Name\\" to match the single folder name you want to search, and "C:\Duplicate_Files.txt" to the full path, including the filename of the UTF-8 text document where the duplicate file search results / values will be stored:
PowerShell -NoProfile -ExecutionPolicy Bypass -Command "& {Set-Content -Path 'C:\Duplicate_Files.txt' -value (ls 'E:\Folder_Name_Here\Subfolder_Name\' -recurse | Get-FileHash -Algorithm MD5 | Group -Property Hash | Where { $_.Count -Gt 1 } | % { $_.Group } | Format-Table -Wrap -AutoSize -Property Path | Out-String -Stream -Width 32767 | Select-String -Pattern 'E:\\Folder_Name_Here\\Subfolder_Name\\')}"You can use third-party tools to scan USB flash drives, search for and remove duplicate MP3 files by filename, size or music tags.
This can be achieved using third-party tools.
