Suggestions on how to remove duplicate user id/passwords/notes from different sources?

%3CLINGO-SUB%20id%3D%22lingo-sub-2118527%22%20slang%3D%22en-US%22%3ESuggestions%20on%20how%20to%20remove%20duplicate%20user%20id%2Fpasswords%2Fnotes%20from%20different%20sources%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2118527%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%3EHello.%20I%20have%20many%20outdated%20userids%20and%20passwords%20saved%20in%20a%20third%20party%20application%20called%20Bitwarden.%20I%20use%20this%20as%20a%20backup%20to%20Google%20Chrome.%20Both%20Google%20Chrome%20and%20Bitwarden%20all%20import%20and%20export%20passwords%20in%20.csv%20format.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EUnfortunately%2C%20there's%20no%20built-in%20functionality%20in%20Bitwarden%20to%20remove%20duplicate%20userid%2Fpw%2Fnotes%20combinations.%20Google%20doesn't%20have%20a%20feature%20to%20add%20notes%20to%20my%20userid%2Fpw.%3C%2FSPAN%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%3EWhat%20I%20mean%20by%20*notes*%20is%20a%20separate%20custom%20field%20where%20you%20can%20add%20information%20whatever%20you%20want%20such%20as%20answers%20to%20your%20security%20questions%20like%20what%20is%20your%20favorite%20colour.%3C%2FSPAN%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%3EI'm%20really%20a%20noob%20when%20it%20comes%20to%20Excel%20(I%20mostly%20use%20Google%20sheets%20or%20Excel%20via%20Microsoft%20One%20Drive).%20What%20I%20was%20thinking%20is%20if%20I%20can%20create%20a%20spreadsheet%20and%20insert%20two%20different%20.csv%20files.%20One%20from%20Bitwarden%20and%20the%20other%20from%20Chrome.%3C%2FSPAN%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSPAN%3EThen%20somehow%20sort%20and%20filter%20out%20the%20duplicate%20userid%2Fpws%20while%20giving%20priority%20to%20Bitwarden%20for%20just%20the%20notes%20but%20give%20Chrome%20priority%20for%20everything%20else%20like%20userid%2Fpw%20and%20websites.%20I%20would%20then%20save%20that%20file%20as%20a%20.csv.%20Wipe%20out%20my%20Bitwarden%20passwords%20and%20import%20the%20csv%20with%20updated%20content.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EJust%20to%20add.%20The%20Bitwarden%20file%20is%20what%20I%20need%20to%20be%20updated%2C%20it%20contains%20many%20more%20fields.%20The%20Chrome%20CSV%20file%20is%20rather%20basic.%20I'm%20attaching%20pics%20here.%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22bw_20210206130010.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F253490i277F45FDABBF27B7%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22bw_20210206130010.png%22%20alt%3D%22Bitwarden%22%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EBitwarden%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22chrome.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F253491i2FD98F6304445462%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22chrome.png%22%20alt%3D%22Chrome%22%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EChrome%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EThe%20image%20link%20is%20here%20if%20the%20above%20doesn't%20show%20up%20well%3A%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fimgur.com%2Fa%2FvkUDvWC%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Ehttps%3A%2F%2Fimgur.com%2Fa%2FvkUDvWC%3C%2FA%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EDoes%20anyone%20have%20any%20suggestions%20and%20examples%20how%20I%20can%20accomplish%20the%20above%3F%3C%2FSPAN%3E%3CBR%20%2F%3E%3CSPAN%3EMuch%20thanks!%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2118527%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EExcel%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EFormulas%20and%20Functions%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2120023%22%20slang%3D%22en-US%22%3ERe%3A%20Suggestions%20on%20how%20to%20remove%20duplicate%20user%20id%2Fpasswords%2Fnotes%20from%20different%20sources%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2120023%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F425987%22%20target%3D%22_blank%22%3E%40mathetes%3C%2FA%3E%26nbsp%3BHi.%20Thanks%20for%20replying.%20I%20took%20a%20look%20at%20those%20sites%20with%20the%20UNIQUE%20Function.%20It's%20good%20for%20extracting%20data.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EFrom%20what%20my%20little%20brain%20can%20determine.%20I%20would%20need%20to%20copy%20the%20userid%20and%20pws%20from%20Chrome%20into%20the%20appropriate%20fields%20of%20Bitwarden's%20(BW)%20template.%20Chrome%20has%20the%20most%20current%20info.%20Unfortunately%2C%20Chrome%20does%20not%20have%20most%20of%20the%20fields%20BW%20has.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20would%20then%20need%20to%20sort%20everything%20in%20Excel%20by%20website%20and%20then%20somehow%20have%20Excel%20remove%20the%20older%20passwords%20plus%20the%20duplicate%20cells%20while%20preserving%20the%20notes%20field.%20Once%20that%20is%20done%2C%20save%20the%20CSV%20file%20and%20import%20into%20BW.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20choose%20not%20to%20use%201Password%20because%20the%20free%20version%20is%20limited%2C%20but%20it's%20good%20to%20store%20a%20backup%20once%20things%20are%20current.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ESadly%2C%20I%20lack%26nbsp%3Bthe%20skill%20level%20to%20accomplish%20what%20I%20need%20to%20do%2C%20I%20also%20don't%20have%20the%20aptitude%20beyond%20basic%20sorting%20within%20Excel.%26nbsp%3BI%20wish%20I%20could%20dissect%20or%20structure%20what%20I%20need%20to%20be%20done%20like%20a%20programmer%20could.%20Unfortunately%2C%20my%20mind%20just%20doesn't%20work%20that%20way.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThe%20workaround%20I%20will%20do%20is%20create%20another%20folder%20within%20BW%20and%20import%20my%20Chrome%20userid%20and%20pws%20into%20that.%20When%20I%20come%20to%20a%20website%20that%20needs%20my%20credentials%2C%20I%20will%20be%20prompted%20with%20multiple%20userid%20and%20pw%20options%20until%20such%20time%20BW%20or%20another%20password%20manager%20has%20duplicate%20removal%20features%20added.%20I%20will%20continue%20to%20update%20my%20Chrome%20pws%20and%20then%20delete%20the%20special%20folder%20in%20BW%20and%20import%20my%20Chrome%20pws%20there%2C%20rinse%20and%20repeat.%20So%20much%20for%20merging.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAs%20such%2C%20I%20think%20I%20have%20no%20choice%20but%20to%20give%20up%20trying%20to%20clean%20things%20up.%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThank%20you%26nbsp%3B%20for%20your%20insight.%20Take%20care%20and%20stay%20safe.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2119742%22%20slang%3D%22en-US%22%3ERe%3A%20Suggestions%20on%20how%20to%20remove%20duplicate%20user%20id%2Fpasswords%2Fnotes%20from%20different%20sources%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2119742%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F329437%22%20target%3D%22_blank%22%3E%40JustANoob%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI'm%20going%20to%20refer%20you%20to%20two%20different%20web%20sites%20to%20learn%20UNIQUE.%20I%20do%20see%20that%201Password%20(full%20version%3B%20I%20can't%20speak%20to%20the%20free%2C%20whether%20this%20applies%20or%20not)%20DOES%20allow%20you%20to%20import%20CSV%20files.%20You%20could%20export%20from%20Excel%2C%20once%20cleaned%20up%2C%20as%20a%20CSV.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHere's%20a%20good%20reference%20for%20all%20things%20Excel%3A%20%3CA%20href%3D%22https%3A%2F%2Fexceljet.net%2Fexcel-functions%2Fexcel-unique-function%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fexceljet.net%2Fexcel-functions%2Fexcel-unique-function%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHere's%20a%20good%20video%20introduction%20to%20UNIQUE%20and%20a%20few%20others.%20This%20may%20be%20beyond%20your%20skill%20level%2C%20but%20try%20to%20stick%20with%20it.%20The%20truth%20is%20that%20UNIQUE%20in%20particular%20is%20quite%20easy.%20%3CA%20href%3D%22https%3A%2F%2Fwww.youtube.com%2Fwatch%3Freload%3D9%26amp%3Bv%3D9I9DtFOVPIg%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fwww.youtube.com%2Fwatch%3Freload%3D9%26amp%3Bv%3D9I9DtFOVPIg%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhen%20I%20talked%20of%20combining%2C%20I%20was%20simply%20pictuing%20copying%20from%20one%20(the%20smaller)%20into%20the%20other%2C%20larger.%20Make%20sure%20the%20columns%20are%20aligned%20in%20the%20same%20way.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E(If%20we%20were%20sitting%20down%20face-to-face%2C%20I'd%20be%20happy%20to%20give%20more%20detailed%20instructions%20based%20on%20where%20you%20are%20in%20your%20own%20understanding%2C%20but%20that's%20next%20to%20impossible%20over%20once-a-day%20message%20board%20exchanges.%20So%20if%20you%20need%20more%2C%20see%20if%20you%20can%20find%20a%20friend%20who%20knows%20a%20bit%20more%20about%20Excel.%20This%20is%20not%20rocket%20science.%20The%20best%20thing%20for%20your%20own%20learning%20is%20to%20work%20through%20it.%20Make%20back-up%20copies%20first%20so%20you%20don't%20break%20something%20and%20not%20have%20a%20recovery%20plan.)%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2119723%22%20slang%3D%22en-US%22%3ERe%3A%20Suggestions%20on%20how%20to%20remove%20duplicate%20user%20id%2Fpasswords%2Fnotes%20from%20different%20sources%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2119723%22%20slang%3D%22en-US%22%3EHi.%20Thank%20you%20for%20replying.%20Do%20you%20know%20if%20the%20UNIQUE%20function%20works%20with%20Office%202019%20or%20the%20free%20Excel%20version%20via%20One%20Drive%20and%20your%20Outlook%20account%3F%20If%20yes%2C%20can%20you%20please%20elaborate%20on%20how%20to%20accomplish%20what%20you%20mean%3F%20As%20I%20mentioned%20I'm%20a%20noob%20and%20I%20wouldn't%20know%20how%20to%20combine%20the%20two%20files.%20I'll%20need%20detailed%20instructions%20on%20how%20to%20do%20that%20and%20how%20to%20use%20or%20create%20a%20formula%20using%20the%20UNIQUE%20function.%3CBR%20%2F%3E%3CBR%20%2F%3EI%20have%201Password%20(the%20free%20version)%20and%20Roboform.%20It's%20just%20too%20time-consuming%20to%20go%20through%20900%2B%20passwords.%20That%3B's%20why%20I%20am%20looking%20to%20automate%20the%20process.%20I%20hope%20to%20hear%20back%20from%20you.%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2118632%22%20slang%3D%22en-US%22%3ERe%3A%20Suggestions%20on%20how%20to%20remove%20duplicate%20user%20id%2Fpasswords%2Fnotes%20from%20different%20sources%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2118632%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F329437%22%20target%3D%22_blank%22%3E%40JustANoob%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIf%20you%20have%20access%20to%20the%20UNIQUE%20function--requires%20the%20most%20recent%20version%20of%20Excel--you%20could%20use%20it%20to%20produce%20a%20list%20of%20the%20unique%20combos%20of%20userID%20and%20pw.%20Just%20combine%20the%20files%20from%20both%20of%20your%20current%20lists%20and%20get%20those%20unique%20combos....%20then%20update%20that%20further%2C%20with%20your%20notes%2C%20and%20then%20export.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EHowever%2C%20%3CSTRONG%3E%3CU%3E%3CEM%3Ewhat%20I'd%20really%20recommend%3C%2FEM%3E%3C%2FU%3E%3C%2FSTRONG%3E%20is%20getting%20a%20package%20like%20%3CSTRONG%3E1Password%3C%2FSTRONG%3E%20and%20going%20through%20both%20of%20your%20files%20patiently%20and%20entering%20the%20new%20data%20into%201Password%20(or%20whatever).%20Then%20they'd%20be%20safe%20and%20secure%20and%20accessible%20to%20you%20on%20any%20and%20all%20of%20your%20devices.%20%3CA%20href%3D%22https%3A%2F%2F1password.com%2F%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ehttps%3A%2F%2F1password.com%2F%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20used%20to%20have%20a%20homegrown%20system%20myself%20...%20begun%20back%20in%20the%20days%20of%20the%20Palm%20Pilot%20(do%20you%20remember%20those%3F)%20--%20but%20now%20rely%20on%201Password.%20It%20took%20a%20while%20to%20transfer%20all%20the%20data%20over%2C%20manually%20as%20I%20recall.......but%20well%20worth%20it.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Occasional Contributor

Hello. I have many outdated userids and passwords saved in a third party application called Bitwarden. I use this as a backup to Google Chrome. Both Google Chrome and Bitwarden all import and export passwords in .csv format.

 

Unfortunately, there's no built-in functionality in Bitwarden to remove duplicate userid/pw/notes combinations. Google doesn't have a feature to add notes to my userid/pw.

What I mean by *notes* is a separate custom field where you can add information whatever you want such as answers to your security questions like what is your favorite colour.

I'm really a noob when it comes to Excel (I mostly use Google sheets or Excel via Microsoft One Drive). What I was thinking is if I can create a spreadsheet and insert two different .csv files. One from Bitwarden and the other from Chrome.

Then somehow sort and filter out the duplicate userid/pws while giving priority to Bitwarden for just the notes but give Chrome priority for everything else like userid/pw and websites. I would then save that file as a .csv. Wipe out my Bitwarden passwords and import the csv with updated content.

 

Just to add. The Bitwarden file is what I need to be updated, it contains many more fields. The Chrome CSV file is rather basic. I'm attaching pics here. 

 

BitwardenBitwarden

 

ChromeChrome

 

The image link is here if the above doesn't show up well: https://imgur.com/a/vkUDvWC

 

Does anyone have any suggestions and examples how I can accomplish the above?
Much thanks!

4 Replies

@JustANoob 

 

If you have access to the UNIQUE function--requires the most recent version of Excel--you could use it to produce a list of the unique combos of userID and pw. Just combine the files from both of your current lists and get those unique combos.... then update that further, with your notes, and then export.

 

However, what I'd really recommend is getting a package like 1Password and going through both of your files patiently and entering the new data into 1Password (or whatever). Then they'd be safe and secure and accessible to you on any and all of your devices. https://1password.com/

 

I used to have a homegrown system myself ... begun back in the days of the Palm Pilot (do you remember those?) -- but now rely on 1Password. It took a while to transfer all the data over, manually as I recall.......but well worth it.

 

Hi. Thank you for replying. Do you know if the UNIQUE function works with Office 2019 or the free Excel version via One Drive and your Outlook account? If yes, can you please elaborate on how to accomplish what you mean? As I mentioned I'm a noob and I wouldn't know how to combine the two files. I'll need detailed instructions on how to do that and how to use or create a formula using the UNIQUE function.

I have 1Password (the free version) and Roboform. It's just too time-consuming to go through 900+ passwords. That;'s why I am looking to automate the process. I hope to hear back from you.

@JustANoob 

 

I'm going to refer you to two different web sites to learn UNIQUE. I do see that 1Password (full version; I can't speak to the free, whether this applies or not) DOES allow you to import CSV files. You could export from Excel, once cleaned up, as a CSV.

 

Here's a good reference for all things Excel: https://exceljet.net/excel-functions/excel-unique-function

 

Here's a good video introduction to UNIQUE and a few others. This may be beyond your skill level, but try to stick with it. The truth is that UNIQUE in particular is quite easy. https://www.youtube.com/watch?reload=9&v=9I9DtFOVPIg

 

When I talked of combining, I was simply pictuing copying from one (the smaller) into the other, larger. Make sure the columns are aligned in the same way.

 

(If we were sitting down face-to-face, I'd be happy to give more detailed instructions based on where you are in your own understanding, but that's next to impossible over once-a-day message board exchanges. So if you need more, see if you can find a friend who knows a bit more about Excel. This is not rocket science. The best thing for your own learning is to work through it. Make back-up copies first so you don't break something and not have a recovery plan.)

Learn everything about our brand-new Dynamic Arrays and how you can use them to build advanced spreadsheets. Arrays (CSE) have long been present in Excel, bu...

@mathetes Hi. Thanks for replying. I took a look at those sites with the UNIQUE Function. It's good for extracting data.

 

From what my little brain can determine. I would need to copy the userid and pws from Chrome into the appropriate fields of Bitwarden's (BW) template. Chrome has the most current info. Unfortunately, Chrome does not have most of the fields BW has.

 

I would then need to sort everything in Excel by website and then somehow have Excel remove the older passwords plus the duplicate cells while preserving the notes field. Once that is done, save the CSV file and import into BW.

 

I choose not to use 1Password because the free version is limited, but it's good to store a backup once things are current.

 

Sadly, I lack the skill level to accomplish what I need to do, I also don't have the aptitude beyond basic sorting within Excel. I wish I could dissect or structure what I need to be done like a programmer could. Unfortunately, my mind just doesn't work that way.

 

The workaround I will do is create another folder within BW and import my Chrome userid and pws into that. When I come to a website that needs my credentials, I will be prompted with multiple userid and pw options until such time BW or another password manager has duplicate removal features added. I will continue to update my Chrome pws and then delete the special folder in BW and import my Chrome pws there, rinse and repeat. So much for merging.

 

As such, I think I have no choice but to give up trying to clean things up. 

 

Thank you  for your insight. Take care and stay safe.