Home
%3CLINGO-SUB%20id%3D%22lingo-sub-333945%22%20slang%3D%22en-US%22%3ENEW%20REFERENCE%20ARCHITECTURE%3A%20Enterprise-grade%20conversational%20bot%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-333945%22%20slang%3D%22en-US%22%3E%3CP%3EOur%20seventh%20%3CSPAN%3EAI%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FRefArchs%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ereference%20architecture%3C%2FA%3E%20(on%20the%20%3C%2FSPAN%3E%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FArchitecture%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Architecture%20Center%3C%2FA%3E%3CSPAN%3E)%20is%20written%20by%20AzureCATs%3C%2FSPAN%3E%20%3CEM%3E%3CSTRONG%3EAbhinav%20Mithal%3C%2FSTRONG%3E%20%3C%2FEM%3Eand%20%3CEM%3E%3CSTRONG%3ERobert%20Alexander%3C%2FSTRONG%3E%3C%2FEM%3E%2C%20and%20published%20by%20%3CEM%3E%3CSTRONG%3EMike%20Wasson%3C%2FSTRONG%3E%3C%2FEM%3E.%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fconversational-bot%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EEnterprise-grade%20conversational%20bot%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EReference%20architectures%20provide%20a%20consistent%20approach%20and%20best%20practices%20for%20a%20given%20solution.%20Each%20architecture%20includes%20recommended%20practices%2C%20along%20with%20considerations%20for%20scalability%2C%20availability%2C%20manageability%2C%20security%2C%20and%20more.%20The%20full%20array%20of%20reference%20architectures%20is%20available%20on%20the%20Azure%20Architecture%20Center.%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fconversational-bot%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20862px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F72550i177D37747D2E4CC7%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22Enterprise_grade_conversational_bot.png%22%20title%3D%22Enterprise_grade_conversational_bot.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FA%3E%3C%2FP%3E%0A%3CP%3EThis%20reference%20architecture%20describes%20how%20to%20build%20an%20enterprise-grade%20conversational%20bot%20(chatbot)%20using%20the%20%3CA%20href%3D%22https%3A%2F%2Fdev.botframework.com%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Bot%20Framework%3C%2FA%3E.%20Each%20bot%20is%20different%2C%20but%20there%20are%20some%20common%20patterns%2C%20workflows%2C%20and%20technologies%20to%20be%20aware%20of.%20For%20a%20bot%20to%20serve%20enterprise%20workloads%2C%20there%20are%20many%20design%20considerations%20to%20ponder%20beyond%20the%20core%20functionality.%20This%20article%20covers%20the%20most%20essential%20design%20aspects%2C%20and%20introduces%20the%20tools%20needed%20to%20build%20a%20robust%2C%20secure%2C%20and%20actively%20learning%20bot.%3C%2FP%3E%0A%3CP%3EThis%20reference%20architecture%20uses%20a%20significant%20number%20of%20Azure%20services.%20Your%20own%20bot%20may%20not%20use%20all%20of%20these%20services%2C%20or%20may%20incorporate%20additional%20services.%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fconversational-bot%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ECheck%20out%20the%26nbsp%3Barticle%20for%20additional%20detail%20on%20the%20services%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EBot%20logic%20and%20user%20experience%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fbot-service%2Fbot-builder-basics%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EBot%20Framework%20Service%3C%2FA%3E%20(BFS)%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fapp-service%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20App%20Service%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSTRONG%3EBot%20cognition%20and%20intelligence%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fcognitive-services%2Fluis%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ELanguage%20Understanding%3C%2FA%3E%20(LUIS)%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fsearch%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Search%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fcognitive-services%2FQnAMaker%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EQnA%20Maker%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fapp-service%2Foverview%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EWeb%20app%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSTRONG%3EData%20ingestion%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fdata-factory%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Data%20Factory%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Flogic-apps%2Flogic-apps-overview%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ELogic%20Apps%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-functions%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Functions%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSTRONG%3ELogging%20and%20monitoring%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-monitor%2Fapp%2Fapp-insights-overview%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EApplication%20Insights%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fstorage%2Fblobs%2Fstorage-blobs-introduction%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Blob%20Storage%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fcosmos-db%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3ECosmos%20DB%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fpower-bi%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EPower%20BI%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSTRONG%3ESecurity%20and%20governance%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Factive-directory%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Active%20Directory%3C%2FA%3E%20(Azure%20AD)%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fkey-vault%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20Key%20Vault%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSTRONG%3EQuality%20assurance%20and%20enhancements%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fsolutions%2Fdevops%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EAzure%20DevOps%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fproducts%2Fvisual-studio-code%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EVS%20Code%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CEM%3ETopics%26nbsp%3Bcovered%20include%3A%3C%2FEM%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EArchitecture%3CUL%3E%0A%3CLI%3EBot%20logic%20and%20user%20experience%3C%2FLI%3E%0A%3CLI%3EBot%20cognition%20and%20intelligence%3C%2FLI%3E%0A%3CLI%3EData%20ingestion%3C%2FLI%3E%0A%3CLI%3ELogging%20and%20monitoring%3C%2FLI%3E%0A%3CLI%3ESecurity%20and%20governance%3C%2FLI%3E%0A%3CLI%3EQuality%20assurance%20and%20enhancements%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3EDesign%20considerations%3CUL%3E%0A%3CLI%3EUser%20message%20flow%3C%2FLI%3E%0A%3CLI%3ESystem%20data%20flow%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3EBuilding%20a%20bot%3CUL%3E%0A%3CLI%3EIngest%20data%3C%2FLI%3E%0A%3CLI%3ECore%20bot%20logic%20and%20UX%3C%2FLI%3E%0A%3CLI%3EAdd%20smarts%20to%20your%20bot%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3CLI%3EQuality%20assurance%20and%20enhancements%3C%2FLI%3E%0A%3CLI%3EAvailability%20considerations%3C%2FLI%3E%0A%3CLI%3ESecurity%20considerations%3C%2FLI%3E%0A%3CLI%3EManageability%20considerations%3CUL%3E%0A%3CLI%3EMonitoring%20and%20reporting%3C%2FLI%3E%0A%3CLI%3EAutomated%20resource%20deployment%3C%2FLI%3E%0A%3CLI%3EContinuous%20bot%20deployment%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSPAN%3EHead%20over%20to%20the%20Azure%20Architecture%20Center%20to%20learn%20more%20about%20the%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fconversational-bot%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EEnterprise-grade%20conversational%20bot%3C%2FA%3E%3C%2FSPAN%3E%26nbsp%3Breference%20architecture.%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId-1872592520%22%20id%3D%22toc-hId-1962109673%22%3E%26nbsp%3B%3C%2FH1%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH1%20id%3D%22toc-hId--679564441%22%20id%3D%22toc-hId--590047288%22%3ESee%20also%3C%2FH1%3E%0A%3CP%3EAdditional%20related%20AI%20reference%20architectures%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-deep-learning%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EBatch%20scoring%20on%20Azure%20for%20deep%20learning%20models%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Fbatch-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EBatch%20scoring%20of%20Python%20models%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Freal-time-recommendation%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EBuild%20a%20real-time%20recommendation%20API%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Ftraining-deep-learning%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EDistributed%20training%20of%20deep%20learning%20models%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Frealtime-scoring-python%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EReal-time%20scoring%20of%20Python%20Scikit-Learn%20and%20deep%20learning%20models%20on%20Azure%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Farchitecture%2Freference-architectures%2Fai%2Frealtime-scoring-r%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3EReal-time%20scoring%20of%20R%20machine%20learning%20models%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EFind%20all%20our%20reference%20architectures%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FRefArchs%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehere%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22http%3A%2F%2Faka.ms%2FCAT%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%3CIMG%20width%3D%22134%22%20height%3D%22134%22%20class%3D%22alignleft%22%20src%3D%22https%3A%2F%2Fmsdnshared.blob.core.windows.net%2Fmedia%2F2017%2F01%2FAzureCAT_Icon.jpg%22%20border%3D%220%22%20%2F%3E%3C%2FA%3E%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EAzureCAT%20Guidance%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%3E%3CEM%3E%22Hands-on%20solutions%2C%20with%20our%20heads%20in%20the%20Cloud!%22%3C%2FEM%3E%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-333945%22%20slang%3D%22en-US%22%3E%3CP%3EThis%20reference%20architecture%20describes%20how%20to%20build%20an%20enterprise-grade%20conversational%20bot%20(chatbot)%20using%20the%20%3CA%20href%3D%22https%3A%2F%2Fdev.botframework.com%2F%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%20target%3D%22_blank%22%3EAzure%20Bot%20Framework%3C%2FA%3E.%20Each%20bot%20is%20different%2C%20but%20there%20are%20some%20common%20patterns%2C%20workflows%2C%20and%20technologies%20to%20be%20aware%20of.%20For%20a%20bot%20to%20serve%20enterprise%20workloads%2C%20there%20are%20many%20design%20considerations%20to%20ponder%20beyond%20the%20core%20functionality.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-333945%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAI%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Microsoft

Our seventh AI reference architecture (on the Azure Architecture Center) is written by AzureCATs Abhinav Mithal and Robert Alexander, and published by Mike Wasson.

Reference architectures provide a consistent approach and best practices for a given solution. Each architecture includes recommended practices, along with considerations for scalability, availability, manageability, security, and more. The full array of reference architectures is available on the Azure Architecture Center.

Enterprise_grade_conversational_bot.png

This reference architecture describes how to build an enterprise-grade conversational bot (chatbot) using the Azure Bot Framework. Each bot is different, but there are some common patterns, workflows, and technologies to be aware of. For a bot to serve enterprise workloads, there are many design considerations to ponder beyond the core functionality. This article covers the most essential design aspects, and introduces the tools needed to build a robust, secure, and actively learning bot.

This reference architecture uses a significant number of Azure services. Your own bot may not use all of these services, or may incorporate additional services. Check out the article for additional detail on the services.

Bot logic and user experience

Bot cognition and intelligence

Data ingestion

Logging and monitoring

Security and governance

Quality assurance and enhancements

 

Topics covered include:

  • Architecture
    • Bot logic and user experience
    • Bot cognition and intelligence
    • Data ingestion
    • Logging and monitoring
    • Security and governance
    • Quality assurance and enhancements
  • Design considerations
    • User message flow
    • System data flow
  • Building a bot
    • Ingest data
    • Core bot logic and UX
    • Add smarts to your bot
  • Quality assurance and enhancements
  • Availability considerations
  • Security considerations
  • Manageability considerations
    • Monitoring and reporting
    • Automated resource deployment
    • Continuous bot deployment

Head over to the Azure Architecture Center to learn more about the Enterprise-grade conversational bot reference architecture.

 

 

See also

Additional related AI reference architectures:

 

Find all our reference architectures here.

 

AzureCAT Guidance

"Hands-on solutions, with our heads in the Cloud!"