Forum Discussion

Latav_Tech's avatar
Latav_Tech
Copper Contributor
Jul 16, 2019

SQL Server 2019 Server Level collation change to UTF8 invalidating Latin character values

We have installed SQL2019 CTP3 in our Test Server where we are trying to convert Server level collation from SQL_Latin1_General_CP1_CI_AS to Latin1_General_100_CI_AS_SC_UTF8.

 

We have few DB's available on the server and we were using following command to change the server level collation

sqlservr -c -m -T4022 -T3659 -s"servername" -q"Latin1_General_100_CI_AS_SC_UTF8"

 

With the above command we could find that server level collation, Database level collation and column collation for charter types are getting changed. Few of our tables stores Latin characters in column values. with the above change we could find the Latin characters are getting updated with some invalid characters which is causing our application functionality failure

 

Values before Server level collation change :

 

€‚ƒ„…†‡ˆ‰Š‹ŒŽ‘’“”•–—˜™š›œžŸ¡¢£¤¥¦§¨©ª«¬-®¯°±²³´µ¶•¸¹º»¼½¾¿ÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖרÙÚÛÜÝÞßàáâãäåæçèéêëìíîïðñòóôõö÷øùúûüý

 

Values after collation change

 

���������������������������������������-��������������������������������������������������������������������������������

 

Does anyone has faced this issue? do we have any resolution to this issue?

3 Replies

  • Is this still happening in RTM? If you tested and it is, please reach out to customer support, or email me at pedro dot lopes Pernille-Eskebo.com

      • Latav_Tech's avatar
        Latav_Tech
        Copper Contributor

        Latav_Tech 

         

        Hi @Pedro Lopes 

         

        We have performed testing with SQL server 2019 RTM version 

        "Microsoft SQL Server 2019 (RTM-GDR) (KB4517790) - 15.0.2070.41 (X64)   Oct 28 2019 19:56:59   Copyright (C) 2019 Microsoft Corporation  Developer Edition (64-bit) on Windows Server 2016 Datacenter 10.0 <X64> (Build 14393: ) (Hypervisor)" and still seeing this issue.

         

        Actual data before conversion is : 

        "€‚ƒ„…†‡ˆ‰Š‹ŒŽ‘’“”•–—˜™š›œžŸ¡¢£¤¥¦§¨©ª«¬-®¯°±²³´µ¶•¸¹º»¼½¾¿ÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖרÙÚÛÜÝÞßàáâãäåæçèéêëìíîïðñòóôõö÷øùúûüý"

         

        Data after conversion is :

        ���������������������������������������-��������������������������������������������������������������������������������

         

        We are using following command to perform the conversion.

         

        sqlservr -c -m -T4022 -T3659 -s"RTMUTF8" -q"Latin1_General_100_CI_AS_SC_UTF8"

         

        Thanks

        Lata

Resources