files saving as Lastname uparrow J Firstname

I'm making files in Excel for lists of authors and their books.   I'm trying to save them as Lastname, Firstname, but instead of the comma it puts an up arrow and a J.  Why, and how do I fix this?