How to incorporate special characters (like umlauts) into CSV files and maintain the characters?

We have a contact export we use that has many names in it, and we now have several names with umlaut characters in them (Ü). When it comes into the export CSV file, the name looks like this: DÓ§rte w...