RDMA SMB - BSOD (LM_SERVER_INTERNAL_ERROR)

%3CLINGO-SUB%20id%3D%22lingo-sub-2364554%22%20slang%3D%22en-US%22%3ERDMA%20SMB%20-%20BSOD%20(LM_SERVER_INTERNAL_ERROR)%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2364554%22%20slang%3D%22en-US%22%3E%3CP%3EHello%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWe%20have%20next%20env%3A%3CBR%20%2F%3E-%20Windows%20Server%202016%3CBR%20%2F%3E-%20mellanox%20Connectx-3%20(fw%3A2.42.5000%3B%20winof%3A%205.50.53)%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ECreated%20hyper-v%20team%20switch%2C%20then%20vNICs%2C%20qos%2C%20etc...%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhen%20RDMA%20enabled%20on%20one%20vnic%20and%20disabled%20on%20other%20vnics%20and%20copying%20big%20file%20~20TB%20-%20windows%20(smb%20server%20side)%20is%20crashed%20with%20error%20LM_SERVER_INTERNAL_ERROR%3A%3CBR%20%2F%3EPS%20C%3A%5CUsers%5Cpnd%26gt%3B%20get-netadapterrdma%3C%2FP%3E%3CP%3EName%20InterfaceDescription%20Enabled%3C%2FP%3E%3CHR%20%2F%3E%3CP%3EvEthernet%20(v23-cluster)%20Hyper-V%20Virtual%20Ethernet%20Adapter%20%233%20False%3CBR%20%2F%3EvEthernet%20(v22-lm)%20Hyper-V%20Virtual%20Ethernet%20Adapter%20%232%20True%3CBR%20%2F%3EvEthernet%20(v21)%20Hyper-V%20Virtual%20Ethernet%20Adapter%20False%3CBR%20%2F%3Eib2%20Mellanox%20ConnectX-3%20Ethernet%20Adapter%20True%3CBR%20%2F%3Eib1%20Mellanox%20ConnectX-3%20Ethernet%20Adapter%20%232%20True%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhen%20copying%20small%20file%20~1TB%20-%20windows%20(smb%20server%20side)%26nbsp%3Bnot%20crashed%3CBR%20%2F%3EWhen%20rdma%20is%20disabled%20and%20no%20matter%20for%20file%20size%20-%26nbsp%3Bwindows%20(smb%20server%20side)%26nbsp%3Bnot%20crached.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EAlso%20I%20tested%20this%20on%20two%20different%20servers.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EP.S.%26nbsp%3BI%20posted%20it%20on%20%E2%80%9CQ%26amp%3BA%E2%80%9D%3A%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fanswers%2Fquestions%2F392384%2Frdma-smb-bsod-lm-server-internal-error.html%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3Ehttps%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fanswers%2Fquestions%2F392384%2Frdma-smb-bsod-lm-server-internal-error.html%3C%2FA%3E%26nbsp%3B%2C%20but%20didn't%20get%20normal%20answer.%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2364554%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EStorage%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EWindows%20Server%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Occasional Visitor

Hello,

 

We have next env:
- Windows Server 2016
- mellanox Connectx-3 (fw:2.42.5000; winof: 5.50.53)

 

Created hyper-v team switch, then vNICs, qos, etc...

 

When RDMA enabled on one vnic and disabled on other vnics and copying big file ~20TB - windows (smb server side) is crashed with error LM_SERVER_INTERNAL_ERROR:
PS C:\Users\pnd> get-netadapterrdma

Name InterfaceDescription Enabled


vEthernet (v23-cluster) Hyper-V Virtual Ethernet Adapter #3 False
vEthernet (v22-lm) Hyper-V Virtual Ethernet Adapter #2 True
vEthernet (v21) Hyper-V Virtual Ethernet Adapter False
ib2 Mellanox ConnectX-3 Ethernet Adapter True
ib1 Mellanox ConnectX-3 Ethernet Adapter #2 True

 

When copying small file ~1TB - windows (smb server side) not crashed
When rdma is disabled and no matter for file size - windows (smb server side) not crached.

 

Also I tested this on two different servers.

 

P.S. I posted it on “Q&A”: https://docs.microsoft.com/en-us/answers/questions/392384/rdma-smb-bsod-lm-server-internal-error.htm... , but didn't get normal answer.

 

Thanks.

0 Replies