Forum Discussion

mozbun's avatar
mozbun
Copper Contributor
Sep 20, 2023

Sporadic Decompress Errors

I have a pipeline with a copy activity where the source files are large gzip files that are hosted on a website, so the copy activity downloads them via https. I have the source files configured with the correct url and using the .gz compression type. What I find is that I sporadically get "invalid format" errors when the activity tries to decompress the file. My assumption is that occasionally the file is getting corrupted somehow on the download, but what would cause this? Is there any way to prevent it? I don't have any issues manually downloading the file and decompressing it.

 

ErrorCode=InvalidDataFormat,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The source data has an invalid format. Cannot decompress the source data. Source file name: 'file1.txt.gz'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=ICSharpCode.SharpZipLib.SharpZipBaseException,Message=Unexpected EOF,Source=ICSharpCode.SharpZipLib,'

No RepliesBe the first to reply

Resources