External List performance is poor in Office 365

%3CLINGO-SUB%20id%3D%22lingo-sub-50781%22%20slang%3D%22en-US%22%3EExternal%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-50781%22%20slang%3D%22en-US%22%3E%3CP%3EFor%20one%20of%20our%20customer%20we%20have%20implemented%20a%20BCS%20based%20solution%20in%20Office%20365.%20All%20is%20working%20however%20the%20external%20lists%20are%20very%20slow.%20(%20somethign%20like%2020%20seconds%20to%20collect%20infromation)%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EDoes%20anybody%20else%20have%20any%20experience%20with%20BCS%20in%20Office%20365%20connecting%20to%20an%20on-premises%20SQL%20database%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EMiscrosoft%20support%20has%20been%20involved%20and%20they%20say%20that%20this%20is%20expected%20behaviour.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CEM%3E%3CSTRONG%3EKeypoints%20from%20Microsoft%3A%3C%2FSTRONG%3E%3C%2FEM%3E%3C%2FP%3E%3CP%3E%3CEM%3E%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%3CUL%3E%3CLI%3E%3CEM%3ESharePoint%20On-Premises%20environments%20are%20dedicated%20environments%20where%20as%20SharePoint%20Online%20is%20a%20shared%20environment%2C%20hence%20it%20would%20be%20slow%20as%20compared%20to%20SharePoint%20On-Premise.%3C%2FEM%3E%3C%2FLI%3E%3CLI%3E%3CEM%3ESince%20the%20SharePoint%20Online%20List%20has%20to%20fetch%20data%20from%20the%20External%20Database%2C%20it%20would%20take%20some%20time%20for%20it%20to%20fetch%20the%20data%20%26amp%3B%20save%20the%20changes%20to%20the%20External%20Database.%3C%2FEM%3E%3C%2FLI%3E%3C%2FUL%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIf%20point%201%20was%20true%20then%20I%20would%20expct%20to%20see%20a%20huge%20varation%20during%20the%20day%2Fnight.%26nbsp%3B%3C%2FP%3E%3CP%3EIf%20point%202%20was%20true%20then%20I%20would%20expect%20that%20nobody%20would%20implement%20BCS.%20I%20can%20understand%20that%20it%20would%20take%20some%20time%20to%20collect%20information%20but%20not%2020%20seconds%20or%20more.%20We%20found%20that%20all%20CRUD%20operations%20are%20slow.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-50781%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EDeveloper%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51527%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51527%22%20slang%3D%22en-US%22%3E%3CP%3EI%20think%20it%20was%208%20or%2010%20fields%2C%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51417%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51417%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B-ERR%3AREF-NOT-FOUND-%40Dean%20Gross%2C%3C%2FP%3E%3CP%3EDo%20you%20remember%20the%20size%20of%20your%20tables%3F%20We%20now%20found%20that%20tables%20that%20are%20narrow%20(%202-3%20columns%20seem%20to%20work%20ok%2C%20not%20great%20but%20ok).%20Wider%20tables%20seem%20to%20be%20very%20slow.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51404%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51404%22%20slang%3D%22en-US%22%3ENo%2C%20it%20was%20in%20SPOnline%2C%20the%20webservice%20was%20running%20in%20an%20on-premises%20server%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51403%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51403%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F1096%22%20target%3D%22_blank%22%3E%40Dean%20Gross%3C%2FA%3E%2C%20was%20this%20on-premises%3F%20For%20us%20it%20works%20fine%20in%20an%20on-premises%20environment%20but%20in%20Offic%20e365%20it%20is%20very%20poor%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51402%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51402%22%20slang%3D%22en-US%22%3E%3CP%3ESeveral%20years%20ago%2C%20I%20used%20BCS%20with%20a%20web%20service%20to%20get%20data%20and%20I%20don't%20remember%20it%20being%20that%20bad%2C%20it%20was%20not%20snappy%20but%20I%20seem%20to%20recall%20getting%20several%20thousand%20records%20in%20a%20few%20seconds.%20You%20may%20want%20to%20reach%20out%20to%20%3Ca%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F195688%22%3E%40Brett%20Lonsdale%3C%2Fa%3E%20at%20Lightning%20Tools%20to%20see%20if%20they%20have%20any%20suggestions.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-51398%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-51398%22%20slang%3D%22en-US%22%3E%3CP%3EI%20wrote%20up%20the%20details%20on%20my%20blog%20and%20a%20uservoice%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fveenstra.me.uk%2F2017%2F03%2F07%2Foffice-365-bcs-performance-issues-dont-use-it%2F%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fveenstra.me.uk%2F2017%2F03%2F07%2Foffice-365-bcs-performance-issues-dont-use-it%2F%3C%2FA%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fsharepoint.uservoice.com%2Fforums%2F330318-sharepoint-administration%2Fsuggestions%2F18550603-bcs-on-office-365-doesn-t-perform-very-well-and-n%26nbsp%3B%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fsharepoint.uservoice.com%2Fforums%2F330318-sharepoint-administration%2Fsuggestions%2F18550603-bcs-on-office-365-doesn-t-perform-very-well-and-n%26nbsp%3B%3C%2FA%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-50863%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-50863%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B-ERR%3AREF-NOT-FOUND-%40Brent%20Ellis%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThat%20is%20exactly%20what%20we%20are%20doing.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-50860%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-50860%22%20slang%3D%22en-US%22%3EI%20can%20second%20this!%20And%20been%20searching%20for%20solution%20for%20years.%3CBR%20%2F%3E%3CBR%20%2F%3EWe%20arent%20even%20doing%20CRUD%2C%20just%20read-only%20for%20tagging.%20It%20is%20virtually%20unusable.%20I've%20tried%20all%20kinds%20of%20paging%20and%20filters%20and%20search%20criteria%20to%20try%20and%20speed%20things%20up.%20Our%20search%20results%20only%20return%20only%20the%20first%2025%20items%20that%20meet%20the%20criteria%2C%20and%20it%20takes%20approximately%2020%20to%2030%20seconds%20each%20query.%3CBR%20%2F%3E%3CBR%20%2F%3EIn%20our%20case%20we%20are%20doing%20a%20BCS%20to%20ODATA%20connection%20with%20credentials%20in%20the%20Secure%20Store.%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-50857%22%20slang%3D%22en-US%22%3ERe%3A%20External%20List%20performance%20is%20poor%20in%20Office%20365%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-50857%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20Pieter%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3Ehave%20not%20used%20BCS%20for%20a%20long%20long%20time%20cause%20of%20timeing%20issues.%20better%20would%20be%20to%20create%20a%20seperate%20app%2Fwebservice.%20and%20include%20in%20SharePoint%20Framework%20%3A)%3C%2Fimg%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
MVP

For one of our customer we have implemented a BCS based solution in Office 365. All is working however the external lists are very slow. ( somethign like 20 seconds to collect infromation);

 

Does anybody else have any experience with BCS in Office 365 connecting to an on-premises SQL database?

 

Miscrosoft support has been involved and they say that this is expected behaviour.

 

 

Keypoints from Microsoft:

 

  • SharePoint On-Premises environments are dedicated environments where as SharePoint Online is a shared environment, hence it would be slow as compared to SharePoint On-Premise.
  • Since the SharePoint Online List has to fetch data from the External Database, it would take some time for it to fetch the data & save the changes to the External Database.

 

If point 1 was true then I would expct to see a huge varation during the day/night. 

If point 2 was true then I would expect that nobody would implement BCS. I can understand that it would take some time to collect information but not 20 seconds or more. We found that all CRUD operations are slow.

9 Replies
Highlighted

Hi Pieter,

 

have not used BCS for a long long time cause of timeing issues. better would be to create a seperate app/webservice. and include in SharePoint Framework :)

 

Highlighted
I can second this! And been searching for solution for years.

We arent even doing CRUD, just read-only for tagging. It is virtually unusable. I've tried all kinds of paging and filters and search criteria to try and speed things up. Our search results only return only the first 25 items that meet the criteria, and it takes approximately 20 to 30 seconds each query.

In our case we are doing a BCS to ODATA connection with credentials in the Secure Store.
Highlighted

Hi @Brent Ellis,

 

That is exactly what we are doing. 

Highlighted
Highlighted

Several years ago, I used BCS with a web service to get data and I don't remember it being that bad, it was not snappy but I seem to recall getting several thousand records in a few seconds. You may want to reach out to @Brett Lonsdale at Lightning Tools to see if they have any suggestions.

Highlighted

Hi @Dean Gross, was this on-premises? For us it works fine in an on-premises environment but in Offic e365 it is very poor

 

 

Highlighted
No, it was in SPOnline, the webservice was running in an on-premises server
Highlighted

Hi @Dean Gross,

Do you remember the size of your tables? We now found that tables that are narrow ( 2-3 columns seem to work ok, not great but ok). Wider tables seem to be very slow.

Highlighted

I think it was 8 or 10 fields,