Microsoft Data Migration topics

Garbled Characters after scanning an database for Japanese Customer using DMA

himanshus2401 — Tue, 21 Nov 2023 03:59:17 GMT

I have faced an issue where I have scanned multiple databases for an Japanese customer where certain characters are garbled ( maybe written in Japanese ) , has anyone faced similar situation or any way to handle it ?

validating record count at SQL server database tables with migrated azure data lake gen2

sai_sathya — Fri, 29 Sep 2023 10:39:56 GMT

we are migrating out project from onpermise to azure , so on-premise database is the SQL server that we are using and azure datalake gen2 is the storage location where store data currently and so far we are currently validating record count of each table manually from sql server database tables and similarly we write pyspark code in databricks to write those data as parquet file and we validate record count from pyspark manually every time which is time consuming

is that possible execute this process to make it automated in order to save time ?

can this be done by using pyspark code ?

APS to Synapse Migration (Datetime datatype issue)

Santhosh0579 — Wed, 07 Jun 2023 13:42:55 GMT

Hi Everyone,

I am seeking help to fix the issue below.

I followed the steps from github for migrating APS to Synapse.

Link: https://github.com/microsoft/AzureSynapseScriptsAndAccelerators

Source Date values:

Sample External table Script:

CREATE EXTERNAL TABLE [DIM].[account]
(
[ID] [bigint] NOT NULL,
[EffectiveFrom] [datetime] NOT NULL,
[EffectiveTo] [datetime2] NOT NULL,
[ValidFrom] [datetime] NOT NULL,
[ValidTo] [datetime2] NOT NULL
)
WITH (DATA_SOURCE = [datasource_abfss], LOCATION = N'/locxxxxxxx', FILE_FORMAT = [parquet_file_format], REJECT_TYPE = VALUE, REJECT_VALUE = 0 )
GO

SELECT TOP (100) [ID]
,[EffectiveFrom]
,[EffectiveTo]
,[ValidFrom]
,[ValidTo]
FROM [DIM].[account]
GO

Facing challenges for reading datetime columns

A Parquet file was unable to be exported from an ADLS2 blob into an External table.

Here are the Errors:

HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopSqlException: Arithmetic overflow error converting timestamp to data type DATETIME.

*******************************************************************************************************************

2nd try to read from parquet file using Auto generated scripts:

SELECT

TOP 100 *

FROM

OPENROWSET(

BULK 'https://xxxxx.dfs.core.windows.net/srcblob/DIM_account/**',

FORMAT = 'PARQUET'

) AS [result]

Error:

Started executing query at Line 1

Error handling external file: 'Inserting value to batch for column type DATETIME2 failed. Invalid argument provided.'. File/External table name: ''https://xxxxx.dfs.core.windows.net/srcblob/DIM_account/account.snappy.parquet'.

Your assistance in advance is greatly appreciated !

Migrate data from Azure SQL to Azure SQL between two tenants

mrvamsidhar — Mon, 22 May 2023 20:30:37 GMT

Hello, Is it possible to use any azure native migration service to migrate data between Azure SQL to Azure SQL between two tenants?

Enhance Data Migration Assistant

Florian_Mayer — Thu, 09 Jun 2022 19:29:13 GMT

When you try to access an Azure target DB there are only two azure options:

- Azure Directory Integrated Auth
- Azure Directory Password Auth

Now that also MFA is afforded in Azure this option should be integrated in here also!
So there should be a solution for selecting the possible Auth-providers like in SQL-Management Studio.

Best regards.

DMA - CREATE button is disabled with SQL DB Managed Instance as TARGET option.

DRj_12 — Tue, 07 Dec 2021 23:53:38 GMT

Hi Everyone,

Looking for some guidance re SQL DB migration through DMA tool.

When I select "target server type" as "Azure SQL Database Managed Instance" the CREATE button remains disabled (cant click). If I choose any other option for "target server type" CREATE button does gets active. It is just when I select the ..managed instance.. as the target server type option CREATE does not become enabled. I have attached the screenshot. Please advise. This is my first post here, if you see I should be posting in some other forum please guide. Thank you!

Azure Migrate :: online migration only available to Managed Instance

fmantovani — Thu, 08 Apr 2021 09:23:07 GMT

Hello,

I found out that Azure Migrate provides online migration to Managed Instance only.

Azure SQL DB are not covered. Has it always been like that or is that something new?

The only documentation I find online is about Transactional Replication to Azure SQL DB and is something created by a normal user, nothing official:

https://www.youtube.com/watch?v=7QI1VjbS0YI&t=476s&ab_channel=RajasekharReddyBolla

Does anyone know how to do online replication to Azure SQL DB?

Enhanced DMA command line for assessing databases.

haitsong — Mon, 12 Oct 2020 16:56:33 GMT

https://docs.microsoft.com/en-us/sql/dma/dma-assess-sql-data-estate-to-sqldb-commandline?view=sql-server-2017

Migrating Managed Instance to New Region

Luke_Pulis — Tue, 21 Jul 2020 13:16:35 GMT

Hi,

I'm looking to move our managed instance to a new region for functionality reasons and was curious if there is a quick and painless way of going about this? I don't see any quick methods other than transferring db-by-db.. Any suggestions?

Thanks

DMA 5.2 release

siyao — Tue, 05 May 2020 20:36:06 GMT

DMA v5.2 has been released.

Microsoft Virtual Summit April 30: Speakers on Cosmos DB, Data Analytics, Modern Data Warehouse

Angelbeat_Ron_Gerber — Wed, 08 Apr 2020 19:51:17 GMT

Eight Microsoft experts discuss the latest developments around Cloud, Security, Teams/Collaboration, Apps/DevOps, GitHub/Open Source, AI/ML, Containers/Kubernetes, Data Analytics, DB Architecture, Modern Data Warehouse/Data Lake and more. This free, virtual and interactive summit, organized by Angelbeat on behalf of Microsoft, has highly relevant and technical content on all these top issues, plus offers CPE/CEU/CISSP credits. Here is the registration link, where you can signup and see the full schedule.

https://www.angelbeat.com/microsoft-april-30-virtual-summit/

Thursday, April 30, 9:30 AM - 5:30 PM, US Eastern Standard Time

Migrating Microsoft SQL and website to Azure with a Workspace

nsbar450 — Wed, 25 Mar 2020 17:44:00 GMT

We have a custom site that is tied to a Microsoft SQL server. We need to access the program locally because there is no web interface. Can I move the site, database, the program that's tied to the database, and have a virtual workspace?

We have an interface to the database through a custom program. The members of our association access the site and pay their bills and sign up for events and courses through the site. The employees access the database internally through a shared drive. There are scheduled emails that gather data from the database.

I would appreciate any thoughts on this.

Thanks

Migrate SqlServer on premise to azure SQL Server

haitsong — Wed, 04 Mar 2020 18:47:57 GMT

https://datamigration.microsoft.com/scenario/sql-to-azuresqldb?step=1